4 ms·
The attention matrix/matrices are being updated as you talk to it, within the context window.
by Robotbeat 4y ago
The attention matrix/matrices are being updated as you talk to it, within the context window.
- jameshart 4y agoWhich is literally internal state.
- fauxpause_ 4y agoFalse. They are being updated during the response only. Edit: false-ish I suppose. You’re not wrong. But it doesn’t persist in a way people would assume and consider meaningful.
- Robotbeat 4y agoYeah, I was referring to dialogue style interaction, like ChatGPT. It DOES have an internal state depending on version of from 4000 to 32000 tokens. It’s wiped clean between sessions, like a Meeseeks ceasing to exist once its task is finished.