4 ms·
What is "reasoning"? Wikipedia surprised me with this opening paragraph: > Reason is the capacity of applying logic consciously by drawing conclusions from new
by ben_w 3y ago
What is "reasoning"? Wikipedia surprised me with this opening paragraph:
> Reason is the capacity of applying logic consciously by drawing conclusions from new or existing information, with the aim of seeking the truth, with more than 10 or more than 3 evidence, 99.9% reliability or 87.5% reliability.
Apart from the words "consciously" (which has 100 or so different definitions, some of which do and some of which do not apply to AI), and "aim" which can be contentious depending upon if you feel that requires consciousness or can include training rewards… I think the best of them is at the lower of those two mysterious percentages I've never seen discussed before.
And that's despite LLMs being wildly bad at, specifically, logic. Though even this specific weakness in general seems like a very easy thing to get around by hybridising it with the computer it has to run on e.g. by telling it how to use a compiler, as logic is the foundation of the arithmetic that the transformers use to do natural language comprehension in the first place.
- vikramkr 3y agoThat opening for the Wikipedia article looks problematic - it's grammatically nonsense and has random numbers in it - someone should probably open a talk discussion on what happened Edit: yeah that looks like a recent edit. I thought Wikipedia was supposed to be pretty good about flagging this sort of stuff? Does anyone know how to raise the problem to those super editors that run the site? I assume they won't appreciate a random person undoing an edit https://en.wikipedia.org/w/index.php?title=Reason&diff=prev&oldid=1179925542 https://en.wikipedia.org/w/index.php?title=Reason&diff=prev&...
- ben_w 3y agoIf I was on desktop right now, I'd put the new bit after the existing citation and add a new {{citation needed}} for the addition. Don't worry too much about diving in, so long as you comment your changes appropriately when committing, that's the point of the place and how it does the quality control in the first place :)
- vikramkr 3y agoLeaving a citation needed doesn't sound like the right thing to do for the definition of something as big as reason - esp with the grammatical confusion idk what you'd even edit it to to make sense. Like what is a three evidence or a reliability and what do those reliability numbers mean. And the sentence describing those numbers doesn't make sense - is it 10 or 3 or which of those percentages? Idk maybe it should just be undone
- ben_w 3y agoThen be bold with the edits and delete it, just say why in the comment box. The deletion itself is as easy to undo as to perform, and if you say why you're doing it, someone bringing that part back can do a better job next time. :)
- Sharlin 3y ago> And that's despite LLMs being wildly bad at, specifically, logic. I'd say "wildly bad" is wildly exaggerated given that GPT-4 exists, even if you define "logic" as "logical puzzles encoded in natural language" and not "the thing that allows an LLM to reason highly efficiently about what token comes next".
- ben_w 3y agoThe numbers in Table 1 of this paper are mostly worse than I remembered, but I would also note that humans would fail the "can they reason?" standard I quoted, given the grades the species gets on several of the tests: https://arxiv.org/pdf/2304.03439.pdf https://arxiv.org/pdf/2304.03439.pdf Table 2 likewise shows significant weaknesses in GPT-4, worse than I remember, except on MED which was better than I remember it being capable of. > even if you define "logic" as "logical puzzles encoded in natural language" and not "the thing that allows an LLM to reason highly efficiently about what token comes next". I think this is a reasonable thing to say of LLMs specifically[0], given I think most people would agree with the sentence "humans are bad at quantum mechanics" even though that's what our cell chemistry is implemented on. [0] Though not AI in general! One of my recently-developed bug-bears is the conflation of the limits of LLMs with AI even in technical circles. Human brains aren't just a language cortex, there's no reason to look at an isolated language model and assume an AI can't be wired into other things, yet this assumption is baked into quite a lot of talking points even on HN.