2 ms·
ChatGPT seems to have a layer to tokenize at the word level. It doesn't really understand letters or characters in a word. It's also really bad at counting.
by logicallee 4y ago
ChatGPT seems to have a layer to tokenize at the word level. It doesn't really understand letters or characters in a word. It's also really bad at counting.
This example combines two things it is bad at (letters in a word and counting). It is better not to do that.
- chatgptexpert 4y agoI found it really good at counting. I asked it to count the number of nouns, adverbs, and adjectives in the lyrics of a song, and it got it 100% right. Of course it understands letters or characters. You can ask it for a list of possible tokenization of a word and it will list them out. You can then refer to this list and refer to different tokens of the word and it will correctly modify the word according to the token. The trick is that you need to emphasize the idea of a token into its current context. That will make the concept relevant for your current prompt. You have to nudge it in the direction you want, don't assume it always knows what you are talking about.
- mycall 4y agoDon't they use word2vec?