3 ms·
Token cost is prompt + response. In the case of ChatGPT you don't know the full prompt, but they don't charge by tokens for that app. In the API you need to to
by teaearlgraycold 4y ago
Token cost is prompt + response. In the case of ChatGPT you don't know the full prompt, but they don't charge by tokens for that app.
In the API you need to tokenize your input and tokenize the output then add the counts together.