3 ms·
Not the model though. The model really only takes input text and produces output text. Memory within a conversation is achieved by the harness adding the conver
by fipar 4mo ago
Not the model though. The model really only takes input text and produces output text. Memory within a conversation is achieved by the harness adding the conversation (or parts of it) to the input text. The LLM itself has no memory, it’s the augmented system of several orchestrated LLM calls that does.
- nomel 4mo agoWait until you hear about the hippocampus!!! [1] I don't think physical integration within one contained is relevant to system level behavior. [1] https://en.wikipedia.org/wiki/Neuroanatomy_of_memory https://en.wikipedia.org/wiki/Neuroanatomy_of_memory
- fipar 4mo agoI had heard (o rather, read) about the hippocampus before, but I don’t understand how that relates to my claim that the models have no memory.
- nomel 4mo ago> The LLM itself has no memory, it’s the augmented system of several orchestrated LLM calls that does Your own long term memory is the orchestration of systems that make it long term.
- fipar 4mo agoYou seem to be arguing as if I'm saying AI can't think or have memory. Now, my opinion is it currently can't think, but it certainly has memory. However, LLMs don't have memory. That's what I (and others on this thread) responded to, which is unrelated to how my own memory works.