4 ms·
Has anyone played around with GPT itself to see if you can get it to track the number of tokens it's tracking (best if implemented with the least number of toke
by pixl97 4y ago
Has anyone played around with GPT itself to see if you can get it to track the number of tokens it's tracking (best if implemented with the least number of tokens possible)
- lasermatts 4y agoI haven't played too much with doing this programmatically, but OpenAI's Tokenizer tool is a fun way to get an intuition around tokens and text length https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer