2 ms·
No. I never said we figured out cognition. The LLM is still a black box feed forward network. It is the intricacies of how signals interact with each other in
by ninetyninenine 3y ago
No. I never said we figured out cognition.
The LLM is still a black box feed forward network. It is the intricacies of how signals interact with each other in this network that we don't fully understand.
Word prediction and curve fitting are high level concepts we used to build an intelligence we don't fully understand.
Also belief and understanding are orthogonal concepts. I can believe something I don't understand and I can understand something I don't belief.
My claim here is that LLMs understand things from a certain aspect because LLMs can produce output indistinguishable from understanding.
Also because both the human brain and the LLM are black boxes there is no other metric we can use to gauge the level of understanding an LLM has other than comparing it's inputs and outputs to the human brain.