3 ms·
Infants demonstrate reasoning capabilities before they learn language skills. Human reasoning is not derivative of language generation, and it's certainly not d
by danShumway 3y ago
Infants demonstrate reasoning capabilities before they learn language skills. Human reasoning is not derivative of language generation, and it's certainly not derivative of text generation (illiterate humans are still capable of reasoning). Humans demonstrate reasoning even in the absence of language skills.
LLMs approach learning differently -- whatever reasoning they do possess is an emergent property that arises as they get better and better at language generation. In other words, unlike humans, LLMs learn to "speak" before they exhibit behaviors that look like logical reasoning. Humans do the opposite.
- jppittma 3y agoMy blind speculation would be that this property is likely to disappear as more and more text is written by non-thinking agents. Most text on the internet prior to 2022 was written by an agent capable of thinking. That may not be true going forward.
- init2null 3y agoI've been wondering the same thing. It's possible that older pre-LLM data sources may become indispensable for training. It would be both amusing and disturbing to see older Usenet, Slashdot, and Reddit conversations turned into rare and valuable resources.