4 ms·
Roughly speaking, words or word parts. Open AI has an explainer: https://help.openai.com/en/articles/4936856-what-are-tokens-and-how-to-count-them https://help
by andrewmunsell 4y ago
Roughly speaking, words or word parts. Open AI has an explainer:
https://help.openai.com/en/articles/4936856-what-are-tokens-and-how-to-count-them https://help.openai.com/en/articles/4936856-what-are-tokens-...
You can also check your input using their tokenizer:
https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer
So, your example is ~9 tokens
- chirau 4y agoSo does the response count towards the token count?
- andrewmunsell 4y agoIt does, yeah. It's tokens "processed", meaning request & response. The API response will give you a total token count so you can keep track