10 ms·
“Have an internal world model,” or “give the appearance of having an internal world model”? (Disclaimer: I’ve only read the summary, not the full paper) Recen
by gcanyon 3y ago
“Have an internal world model,” or “give the appearance of having an internal world model”?
(Disclaimer: I’ve only read the summary, not the full paper)
Recent papers about advanced Go-playing AIs have made it abundantly clear that, at best, their conceptual understanding of Go is deeply flawed, and at worst, completely absent. Yet under most circumstances they give the appearance of super-human understanding based on superhuman play.
Do we have any reason to think LLMs are different? That they understand anything beyond “this is the best word to go next here.”
To be clear, LLM output is remarkable, all the more so if the above is true.
- galaxytachyon 3y agoI think sometimes it is good to zoom out a little bit and look at things on a higher level. The LLMs are not an organic creature. It doesn't in any shape or way relate to a human being except the knowledge it was trained on. A bacteria shares over 50% of its genetic sequences with a human and we don't see it as anything more than a glorified bionic automaton. An LLM shares 0% with us. In fact its "genetic sequence" is coded on a completely different physics altogether. It is unreasonable to expect it to understand or think the same way an organic creature do. But the outcome of its action is irrefutable. It plays and does things better better than us. That is all we need to evaluate it on. I know that the topic is about "sentience" but my point is we are evaluating a complete alien being using human's standards. Of course we will see that it is lacking. It isn't human.