Likely it made it up, since GPT is based on tokens, not words: - https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer That said, all th

Likely it made it up, since GPT is based on tokens, not words: - https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer That said, all the words listed in the list you provide are treated as tokens. “The” and “the” would not have the same token IDs, but are the same word. “reshape” tokens are [resh][ape] and the token IDs are [3447, 1758]. “Reshape” tokens are [Res][h][ape] and the token IDs are [4965, 71, 1758]. Notice though the “ape” token is the same, since the characters are the same. Not aware of any character sets that are identical, but based on context have different token IDs. ____________ One possible solution to test this would be to ask ChatGPT to list the first 100 token IDs from its training corpus — then if confirm IDs match the IDs match the tokens on the URL listed above, then cross reference the order of the words it originally provided. That said, it’s fair to assume if you did that, the data would contain factual errors or be unrelated gibberish. ____________ Reason I say it’s likely made up is that to my knowledge ChatGPT lacks the abilities of introspection and assimilation. That is, it’s unable to inspect its current state or assimilate its own output beyond a very limited memory window of few thousand tokens. https://twitter.com/goodside/status/1598874674204618753 https://twitter.com/goodside/status/1598874674204618753 ____________ Related questions are here: - https://news.ycombinator.com/item?id=34677573 https://news.ycombinator.com/item?id=34677573