3 ms·
good insight! I use a lookback window of one response, because it gets pretty expensive to do more.
by shahahmed 3y ago
good insight! I use a lookback window of one response, because it gets pretty expensive to do more.
- davidguetta 3y agoWhy is it expensive ? you can't just paste the plain text of the whole interaction as input ?
- shahahmed 3y agoOpenAI charges per token - so whatever I send as context is counted. This easily 2x, 3x, 5x's the costs depending on the length of the chat.