4 ms·
Uh, no? ChatGPT does not have a memory outside of the context that you submit.
by phailhaus 3y ago
Uh, no? ChatGPT does not have a memory outside of the context that you submit.
- stavros 3y agohttps://openai.com/blog/memory-and-new-controls-for-chatgpt https://openai.com/blog/memory-and-new-controls-for-chatgpt
- zoogeny 3y agoI think your use of the word "memory" here is imprecise. For example, I can ask ChatGPT "Give me a 200 word summary of George Orwell's book Animal Farm". It gives me a pretty cogent description of the novel. That knowledge of Animal Farm is somewhere, not in the context. If we don't call that memory, I'm not sure what to call it. Why should I think of this as different than my own memories of the book?
- phailhaus 3y agoThat's encoded in the model weights, not "memory". Basically, there is no context outside of the context that you give the model. When you ask it a question, those model weights don't change. It doesn't "remember" what you asked. This is why chain-of-thought reasoning works so effectively: it lets the model "use" the context as a sort of scratch pad to build up a response. Without it, the model isn't capable of mimicking thought because it's only capable of predicting based on the current context.
- esafak 3y agoThat is memory. Ask ChatGPT a basic fact about universe and it will tell you because it has memorized the answer. You are asking it to learn, or incrementally create new memories. That just has not been implemented yet, due to costs.