3 ms·
How many tokens do you allow per session? I've been thinking about creating a similar app, but I'm a little bit concerned about the unintended costs.
by vitalsea 3y ago
How many tokens do you allow per session? I've been thinking about creating a similar app, but I'm a little bit concerned about the unintended costs.
- bing_dai 3y agoHello! Thanks for the question. I do not myself restrict tokens/session. The model I am using GPT-3.5-Turbo-16k (https://platform.openai.com/docs/models/gpt-3-5 https://platform.openai.com/docs/models/gpt-3-5), allows max 16,385 tokens in total per input/output. So far, I found that each ~10 minute video uses around 1000 tokens. It costs me about 3 cents to summarize, which is not too bad as I don't have many users, and users haven't been requesting summaries for super long videos yet. If this sites gets a lot of interest, I might start restricting something :).. GPT 3.5 Pricing: https://openai.com/pricing https://openai.com/pricing