5 ms·
For all you know, since it works not on text but on a sequence of token IDs, perhaps these two are actually different things, one is a token representing "22" (
by PeterisP 3y ago
For all you know, since it works not on text but on a sequence of token IDs, perhaps these two are actually different things, one is a token representing "22" (which exists in ChatGPT vocabulary) and the other is two separate tokens each representing "2".
- muzani 3y agoI figured it had something to do with tokens, but this is an interesting insight I didn't think of. What's funny is if you feed the conversation back into a new chat, it understands that it's obviously wrong, but it will be insistent when it's the same conversation.