3 ms·
I always wondered if ChatGPT was somehow stateful. I assumed that it was not and the statefulness was simulated. Assumption validated.
by osigurdson 4y ago
I always wondered if ChatGPT was somehow stateful. I assumed that it was not and the statefulness was simulated. Assumption validated.
- valine 4y agoI don’t believe this was ever in question. You can think of the model as a giant function that takes a list vectors as input and spits out a new vector. If you want the model to remember something, you have to include it in the list of input vectors for every request going forward.
- ShamelessC 4y agoIt’s stateful in the web demo. But they do so by prepending chat history to new requests and automatically summarizing history once the model’s context window is exceeded.
- cubefox 4y agoI don't think they are doing summaries actually. Just cutting off the oldest parts of the conversation.
- osigurdson 4y agoSummarizing would make sense however.
- cubefox 4y agoTrue