3 ms·
I haven't played too much with doing this programmatically, but OpenAI's Tokenizer tool is a fun way to get an intuition around tokens and text length https://
by lasermatts 4y ago
I haven't played too much with doing this programmatically, but OpenAI's Tokenizer tool is a fun way to get an intuition around tokens and text length
https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer