3 ms·
Thank you, that's really insightful! Presumably you could get it to summarize the conversation when the conversation reaches max tokens.
by shrimpx 4y ago
Thank you, that's really insightful! Presumably you could get it to summarize the conversation when the conversation reaches max tokens.
- shagie 4y agoLikely yes. You could even switch to a less intensive model for doing that (e.g. Curie). The Curie model is 1/10th as costly as Davinci to run. Running 8k tokens through Davinci is $0.16 while Curie would only be $0.016 - and that's likely showing up in back end compute and should be considered if someone was building their own chat bot on top of gpt3.