4 ms·
The conclusions of the authors that LLMs can reason inductively very well runs counter to what I've read elsewhere. A big part of doing induction is the abilit
by randcraw 2y ago
The conclusions of the authors that LLMs can reason inductively very well runs counter to what I've read elsewhere. A big part of doing induction is the ability to generalize a shared pattern from multiple disparate examples, recognizing the essential elements that are necessary and sufficient to satisfy that pattern's operators' constraints. To date, I've seen consensus that LLMs can match verbs or basic relational operators across examples, thereby associating the mechanisms in similar events that lead to similar outcomes. But extending that facility further, to employing predicate logic operators, or even the simpler propositional ones appears to fall largely outside LLM capabilities. To suggest then that LLMs can then perform higher-order reasoning skills yet, like the modeling of contrapositives, this seems quite a stretch.
- golergka 2y agoI've just successfully chatted to ChatGPT about equivalence or at least high similarities between QFT, neural networks and cellular automata (referencing Wofram's work). Does that pattern matching count?
- Vampiero 2y agoNo but GPT is really good at fooling laymen who are not experts of a field, and it stands to reason that it just fed you a bunch of bs
- xwolfi 2y agoAnd you were able to verify, of course, that anything new or surprising to you (as in, not a simple derivation of your own prompts), was true ? I noticed that if I ask it to tell me how good cryptocurrencies are, it'll do it, and then if I say I disagree and they're wrong, it'll simply switch and agree with me as well. The thing has no care for truth, no opinion of its own, no ability to insist, and just feeds you whatever is statistically close to your own questions.
- 082349872349872 2y agoCan LLM-based tools even handle the donkey's bridge of syntactic consequence ("A->B & A; B?") yet? Lagniappe: https://www.youtube.com/watch?v=9B2ww3fiX30 https://www.youtube.com/watch?v=9B2ww3fiX30