6 ms·
One simple answer that I don't see people give often to this question is: yes, but only the extent which reasoning is reflected in language. This explanation p
by lukev 2y ago
One simple answer that I don't see people give often to this question is: yes, but only the extent which reasoning is reflected in language.
This explanation pretty much tracks exactly with model performance on reasoning tasks.
Think about how you reason. Even if you write up the results of a problem you're trying to solve, you don't write down every granular mental step you took to get there, or every line of thought you considered and then abandoned.
- Hugsun 2y agoThat is exactly the point I'm trying to make in the chapter They don't reason like us: https://www.arnaldur.be/writing/about/large-language-model-reasoning#they-dont-reason-like-us https://www.arnaldur.be/writing/about/large-language-model-r...
- area51org 2y agoIn other words, it can't think or reason on its own. It depends on prior human thought and work in order to approximate "intelligence".
- EnergyAmy 2y agoDoes that mean if I learn by reading books written by other people, I'm not intelligent?
- Chyzwar 2y agoIf learn to remember content or order of words, then no. If learn to improve your internal model of the world, then you are intelligent.
- Hugsun 2y agoNo. It could think on it's own, like MuZero does. It becomes intelligent by learning from prior human work, like every intelligent being.
- lukev 2y agoWell, that's the great question. If there's enough of the "essence of reason" represented in human text, then it's possible in theory some sufficiently large LLM could eventually could grok it and fully generalize over rational thought (i.e, AGI). Personally I'm extremely skeptical. There's quite a lot of machinery in the brain other than language, and conscious rationality also runs in a constant loop, not a single forward pass through the weights. I can't disprove the possibility. But if I were a betting man, I'd go all in on LLMs improvements adopting a sigmoid curve rather than an exponential one.