4 ms·
> An LLM cannot remember anything it didn't write down. It can't do that at all. Ok, but I'm not sure what that has to do with knowledge. You can ask ChatGPT t
by naasking 3y ago
> An LLM cannot remember anything it didn't write down. It can't do that at all.
Ok, but I'm not sure what that has to do with knowledge. You can ask ChatGPT to reflect on and correct its own answers, so it clearly has access to its own outputs, which is a form of memory.
- jochem9 3y agoBy default ChatGPT keeps a context of 8000 tokens, which includes user provided prompts. That's the size of the working memory.