3 ms·
How is it that cheap?! I ran three queries on langchain yesterday with two ConstitionalPrompts and it cost $0.22 - made me realize deploying my project for chea
by robopsychology 4y ago
How is it that cheap?! I ran three queries on langchain yesterday with two ConstitionalPrompts and it cost $0.22 - made me realize deploying my project for cheap could be expensive quick.
- kami8845 4y agoGPT3.5 Turbo pricing is 10k tokens or ~7500 words for $0.02. Though note that every API request includes the entire chat context and charges for input & output tokens. https://openai.com/pricing https://openai.com/pricing
- monkmartinez 4y agoYou need to check which model you are using, also... LangChain runs through the model several times with increased token count on each successive call.
- robopsychology 4y agoYeah I assumed it would be doing several times but still more expensive than OP mentioned. I think the issue is I'm using davinci-003
- drusepth 4y agoYeah, davinci-003 is gonna be gpt3, which is more expensive than 3.5. One more anecdote: I've been running a half dozen gpt3.5 IRC bots for a few weeks and their total cost was less than a dollar. A few hours of playing around with LangChain on gpt3 cost me almost $4 before I realized I needed to switch to 3.5, though even then it still uses a ton of tokens every chain.
- robopsychology 4y agoThanks, I'll do that later