4 ms·
That’s not learning. That’s carrying over context that you are trusting is correctly summarised over from one conversation to the next.
by Dansvidania 8mo ago
That’s not learning. That’s carrying over context that you are trusting is correctly summarised over from one conversation to the next.
- regularfry 8mo agoWhich sounds uncomfortably like human memory, which gets rewritten from one recollection to the next. Somehow, we cope.
- 0xbadcafebee 8mo agoEver seen the movie Memento? That's LLM memory.
- Dansvidania 8mo agoI disagree. Human memory is literally changing the weights in your neural network. Like, exactly the same. So in the machine learning world, it would need to be continuous re-training (I think its called fine-tuning now?). Context is not "like human memory". It's more like writing yourself a post-it note that you put in a binder and hand over to a new person to continue the task at a later date. Its just words that you write to the next person that in LLM world happens to be a copy of the same you that started, no learning happens. It might guide you, yes, but that's a different story.