4 ms·
I think you will consume a lot of tokens very quickly as you have to send the entire chat history back and forth if you want to append another chat message.
by WolfOliver 4y ago
I think you will consume a lot of tokens very quickly as you have to send the entire chat history back and forth if you want to append another chat message.
- dnadler 4y agoThis is exactly right. It's cheap, but not as cheap as people think. Conversations get exponentially more expensive with message length.