5 ms·
It’s stateful in the web demo. But they do so by prepending chat history to new requests and automatically summarizing history once the model’s context window i
by ShamelessC 4y ago
It’s stateful in the web demo. But they do so by prepending chat history to new requests and automatically summarizing history once the model’s context window is exceeded.
- cubefox 4y agoI don't think they are doing summaries actually. Just cutting off the oldest parts of the conversation.
- osigurdson 4y agoSummarizing would make sense however.
- cubefox 4y agoTrue