2 ms·
Yeah this is true with every glitch token, the distribution of the tokenizer and the GPT model is very different.
by GaggiX 3y ago
Yeah this is true with every glitch token, the distribution of the tokenizer and the GPT model is very different.