3 ms·
You need to check which model you are using, also... LangChain runs through the model several times with increased token count on each successive call.
by monkmartinez 4y ago
You need to check which model you are using, also... LangChain runs through the model several times with increased token count on each successive call.
- robopsychology 4y agoYeah I assumed it would be doing several times but still more expensive than OP mentioned. I think the issue is I'm using davinci-003
- drusepth 4y agoYeah, davinci-003 is gonna be gpt3, which is more expensive than 3.5. One more anecdote: I've been running a half dozen gpt3.5 IRC bots for a few weeks and their total cost was less than a dollar. A few hours of playing around with LangChain on gpt3 cost me almost $4 before I realized I needed to switch to 3.5, though even then it still uses a ton of tokens every chain.
- robopsychology 4y agoThanks, I'll do that later