3 ms·
The context limit is for request + response, and there is no storage in between requests (ongoing chat interactions are done by adding prior interactions to the
by dragonwriter 4y ago
The context limit is for request + response, and there is no storage in between requests (ongoing chat interactions are done by adding prior interactions to the prompt, so the whole chat – before things start falling out of history – is limited to the context window.)