3 ms·
> They don’t model knowledge, they model statistical matches to desired text. I am not convinced that this is not a method of modelling knowledge. > But start
by dragonwriter 4y ago
> They don’t model knowledge, they model statistical matches to desired text.
I am not convinced that this is not a method of modelling knowledge.
> But start another session, and it can generate the same or similar text that is inconsistent with real-world fact, or even with input.
I’m not sure why this is meaningful, aside from the misleading metaphor of a named LLM as an individual; named LLMs are more analogous to genetic templates that code for some instinctive capabilities; if you want an analog to an individual, a single session (for a chat-oriented LLM-centered system) is the most appropriate unit of analysis.