3 ms·
You make two statements that you seem to think that are at odds with each other, but I don’t think that’s the case. > The hypothesis is that the patient genera
by dimal 3y ago
You make two statements that you seem to think that are at odds with each other, but I don’t think that’s the case.
> The hypothesis is that the patient generates information as a compensatory mechanism to fill holes in one’s memories. It functions for self-coherence, integration of memories, and self-relevance.
> The LLM is choosing a statistically relevant next token, which is wrong because its missed some context.
The reason, both cases, is that there is a lack of context. The reason why the next statistically probable token is chosen is because that is the one that provides coherence. It seems like a similar process.