4 ms·
Isn’t that kind of how the “ChatGPT memory” feature works? I’ve recently seen it tell me that it’s updating memory, and whatever I said does appear under the “M
by radicality 2y ago
Isn’t that kind of how the “ChatGPT memory” feature works? I’ve recently seen it tell me that it’s updating memory, and whatever I said does appear under the “Memory” in the settings.
I’m not familiar though with how the Memory works, ie whether it’s using up context length in every chat or doing something else.
- simonw 2y agoYeah, memory works by injecting everything it has "remembered" as part of the system prompt at the beginning of each new chat session: https://simonwillison.net/2024/Feb/14/memory-and-new-controls-for-chatgpt/ https://simonwillison.net/2024/Feb/14/memory-and-new-control...
- joquarky 2y agoI'm curious how it will avoid filling up the context window as more memories are added.
- refulgentis 2y agoCount the tokens, RAG em down to max count you're willing to pay for
- hackable_sand 2y agoVector compression. "Summarize memories at timestamps: [i, j, k, ...n]" etc. etc. until you have a nice scrapbook of memories. Then you gotta prune low-traffic, low-value vector spaces by whatever heuristic you (or an automated system) deems important.