3 ms·
The compressed one is shorter number of characters but does it have fewer tokens? https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer
by ftxbro 4y ago
The compressed one is shorter number of characters but does it have fewer tokens? https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer