3 ms·
> LLMs by design are not capable of reason. This isn't true. A deep neural network certainly can emulate the logical functions we think of as "reasoning" (ie,
by nl 2y ago
> LLMs by design are not capable of reason.
This isn't true.
A deep neural network certainly can emulate the logical functions we think of as "reasoning" (ie, AND/OR/XOR functions).
See for example:
https://cprimozic.net/blog/boolean-logic-with-neural-networks/ https://cprimozic.net/blog/boolean-logic-with-neural-network...
https://www.cs.toronto.edu/~axgao/cs486686_f21/lecture_notes/Lecture_08_on_Neural_Networks_1.pdf https://www.cs.toronto.edu/~axgao/cs486686_f21/lecture_notes...
https://towardsdatascience.com/emulating-logical-gates-with-a-neural-network-75c229ec4cc9 https://towardsdatascience.com/emulating-logical-gates-with-...
https://medium.com/@stanleydukor/neural-representation-of-and-or-not-xor-and-xnor-logic-gates-perceptron-algorithm-b0275375fea1 https://medium.com/@stanleydukor/neural-representation-of-an...
- amenhotep 2y agoWhat an odd comment. Would you assert also that an 8080 is "capable of reason"?
- nl 2y agoUsually when people are saying "LLMs can't reason" they are claiming they are unable to do logical inference (although the claims are often quite hard to pin down to something specific). Yes, an 8080 is capable of reasoning. Prolog runs well, see for example: https://medium.com/@kenichisasagawa/exploring-the-wonders-of-prolog-my-journey-from-the-1980s-31b4df592ef8 https://medium.com/@kenichisasagawa/exploring-the-wonders-of...
- Kerb_ 2y agoI would say integrated circuits in general are not incapable of reason by design, even if some examples may be. Somehow a bunch of meat and fat is capable of reason, even if my steak isn't.
- nl 2y agoThere’s a lot of negated negatives in that sentence. One might say parsing it is a good example of logical inference which is what I think most people mean when they say “reasoning”.