4 ms·
Not really. The API is stateless, you pass it in a whole conversation and it responds with the next message. The entire conversation including its response is l
by simonbw 3y ago
Not really. The API is stateless, you pass it in a whole conversation and it responds with the next message. The entire conversation including its response is limited to 32k tokens.
- BaculumMeumEst 3y agoi’m just confused because i thought i remembered sending long chunks of code using the api, the request will fail, but then i would split it up and then it would work okay. i guess i’m running into a different limit (not context length), or maybe i’m misremembering