3 ms·Probably a coincidence. The GPT-4 and GPT-3.5 tokenizer has 100k tokens.by sebzim4500 3y agoProbably a coincidence. The GPT-4 and GPT-3.5 tokenizer has 100k tokens.