2 ms·
>> You can do the same in Prolog and similar languages. Is the language/the compiler reasoning? Yes, absolutely. The Prolog interpreter is a resolution-based t
by YeGoblynQueenne 6y ago
>> You can do the same in Prolog and similar languages. Is the language/the
compiler reasoning?
Yes, absolutely. The Prolog interpreter is a resolution-based theorem prover.
You will be very hard pressed to find any AI researcher arguing strongly that
"that's not reasoning". In fact I believe automated theorem proving is one of
the very few cases were you can find so little disagreement about whether
something is "reasoning" or not.
Note also that "reasoning" is not necessary to solve a problem like "10 + 10 =
20. 20 + 20 = ___" (1). Knowlege of addition is sufficient: given knowledge of
addition the result of "20 + 20" can be derived without reference to "10 + 10
= 20". And, absent knowledge of addition, even if a system can answer (1), it
will not be able to answer the majority of similar problems, indicating that
it has only memorised the answer to (1).
A better test of what a system has learned is a question like "10 + 10 = 30.
20 + 20 = ___" (2). The answer to that should still be "40", but again that's
not because of any reasoning; it's because "20 + 20" is always "40", even when
preceded by a false statement. So this kind of question is really not any way
to test reasoning abilities.
Edit: Actually, "Alice was friends with Bob. Alice went to visit her friend
___" (3) is not a very good test for reasoning, either. If I were to answer
"Alice", would you be able to say whether that's true or false? The only way
to make such a decision is in the context of a "closed world assumption"
(incidentally, central to Prolog's theorem proving). However, now you're
making a much more precise claim, that "GPT-3 has learned to answer questions
by making a closed-world assumption". You can test this claim much more
convincingly by asking questions like "Alice is friends with Bob. Is alice
friends with Alice"? The answer should be "no" (or "false", "incorrect", etc).
Has this kind of more formal test been carried out, with GPT-x?