3 ms·
Yes, and I still consider that a poor experimental setup to demonstrate understanding, because by that definition, Wikipedia also "understands" photosynthesis a
by lxgr 3y ago
Yes, and I still consider that a poor experimental setup to demonstrate understanding, because by that definition, Wikipedia also "understands" photosynthesis and the cold war.
My point is that maybe "understanding" isn't all that useful a category for intelligence and/or LLMs.
- koonsolo 3y agoReasoning is deriving new information from information you already know. On Wikipedia I can only see what's already there. ChatGPT is able to derive from things it already knows, or in that sense, reason about it. For example, I can't ask wikipedia which role Brittney Spears would be suited for in the Star Wars triology. I could reason about it and come up with my own solution, and so can ChatGPT.
- lxgr 3y agoYes, but that does not mean that LLMs "understand" showbiz or screenwriting. Being able to talk about a topic and even coming across as knowledgeable and helpful is not the same thing as actually understanding something. This isn't limited to LLMs, of course.
- koonsolo 3y agoIf you can produce the proper output of understanding, why not call it understanding? Can you explain what is the missing component for an LLM to fall into your definition of understanding?