4 ms·
Precisely. The architecture is transparent but the latent representations within and the operations performed by LLMs are not. It's a subject of active researc
by stevenhuang 2y ago
Precisely. The architecture is transparent but the latent representations within and the operations performed by LLMs are not.
It's a subject of active research the extent LLM "reasoning" really is reasoning similar to humans, or something of a strictly weaker class entirely.
Personally I'm of the opinion human reasoning is really just "pattern matching", but we're also still waiting for the cognitive scientists to give us an answer on that one.
- mdp2021 2y ago> I'm of the opinion human reasoning is really just "pattern matching" There are more interpretations of "pattern matching". Of course it seems a fundamental component of generating ideas, but then those ideas are put - by intellectuals - on a bench and criticized actively. The two activities have important differences. First you look and go "they seem four", but then you count to be sure. The second part is absolutely critical to determine a well working reasoner.