4 ms·
What does grok semantics mean, how would you test this? I am not trying to argue that language model are close to human level reasoning or whatever, but it is
by danbruc 4y ago
What does grok semantics mean, how would you test this?
I am not trying to argue that language model are close to human level reasoning or whatever, but it is not obvious to me that a language model of some sort is fundamentally unable to to achieve this.
- AlotOfReading 4y agoThe question of whether language models can "reason" ultimately comes back to the chinese room argument. There aren't any universally accepted resolutions to that argument either, nor whether those limitations (if they exist) are fundamental. However, the current incarnation of LLMs like ChatGPT fail at straightforward reasoning around things like categorizing sailfish and mathematical proofs. I'm incredibly impressed at how powerful the simplistic methods they use are, but the deficiencies make it clear that it's not abstractly reasoning from definitions in the same way humans are able to.
- mcguire 4y agoA fun thing to do: Ask ChatGPT a question, and ask for references. Then try to track down the references. I just asked a simple question about the Thirty Years War, and with the answer it gave me two valid references (including C.V. Wedgewood, yay), and one that was completely made up. As far as I understand, LLMs have no model of reality to base results on; they're just an enormously complex statistical model of "what is the next word in the series".
- vannevar 4y agoIt's also pretty easy to lead ChatGPT into giving contradictory answers to the same question, just by suggesting the answer in the question.