3 ms·
> They don't have agency, because they don't have persistent state. They're like a function that you can query and get an answer. During that answer the LLM has
by messe 1y ago
> They don't have agency, because they don't have persistent state. They're like a function that you can query and get an answer. During that answer the LLM has state, but once it's done the state is gone.
That's solved by the simplest of agents. LLM + ability to read / write a file.
- aniviacat 1y agoBut they can only change their context, not the model itself. Humans update their model whenever they receive new data (which they do continuously). A live-learning AI would be theoretically possible, but so far it hasn't been done (in a meaningful way).
- webstrand 1y agoIt has been tried <https://en.wikipedia.org/wiki/Catastrophic_interference https://en.wikipedia.org/wiki/Catastrophic_interference> but it has been unsuccessful.