3 ms·
In science results matter much more than vague and ill defined assertions. A system reasons and understands when it demonstrates understanding and reasoning. T
by famouswaffles 4y ago
In science results matter much more than vague and ill defined assertions.
A system reasons and understands when it demonstrates understanding and reasoning. That's how you asses reasoning in anything/anybody. Evaluation.
If you want to tell me there's a special distinction between what an LLMs outputs and "true reasoning TM" then cool but when you can't show me what that distinction is, how to test for it, the qualitative or quantitative differences then I'm going to throw your argument away because it's not a valid one. It's just an arbitrary line drawn on sand.
A distinction that can't be tested for is not a distinction.
- adroniser 4y agoThe point is as far as I know it hasn't been properly tested for. No one has come up with a comprehensive framework of tests to evaluate spacial reasoning using entirely sentences that aren't isomorphic to training data.
- bombolo 4y agoTry asking chatgpt to solve a non-well-known programming exercise. It will fail miserably and insist on rehashing the same wrong solution when told that it was wrong. A real person might give up, but would not claim that an obviously wrong answer was in fact the answer.