4 ms·

I’d say it goes very much against the spirit and idea behind the Turing test to fail an AI for having superhuman abilities it fails to hide. As much as I admir

• Barrin92 2y ago
  I think Turing's idea was profound and prescient honestly. The reason he put emphasis on deception and imitation in the test is because he wanted to know whether we had build a thinking machine, or just a tool. As you say, superhuman intelligent computers are not like humans and it's indeed not right to require that from them if we just want to build a knowledge repository. But if you want to know whether we've build a mind, his conception matters. To deceive, you have to have the imagination of what it's like to be you imagining what it's like to be me. You need a model of someone's cognition and your own, in real time while you interact with the world. And just architecturally that's not the case with LLM's. They don't have cognitive processes going on as they're interacting with you, they can't even in theory beat this. It's actually scary to me just how smart Turing was because he immediately recognized, at a time when computers barely existed, that the real test isn't if a machine can play smart but if it can play dumb. Because that eliminates all the parlor tricks and requires actual reflection. Just mind blowing to anticipate that in 1950.
  • _yb2s 2y ago
    You are making the mistake of confusing a mind with a human mind… a vastly different type of mind should not be expected to be good at everything we are good at, even if generally far more intelligent. I think people generally make the same mistake with discounting the more intelligent animals by focusing on their inability to act human, and ignoring or not noticing that they can do things we are incapable of- like a dog navigating spaces in total darkness from scent alone. A human mind, for example is not sufficiently generally intelligent to convincing mimic even a fish mind- we cannot generally emulate minds structured differently from ours- e.g. humans cannot actually do the meta task your concept of the Turing test expects AI to do. Even an actual human mind with vastly different experiences- simulated perfectly in a computer or even just a regular person from a very different culture will fail your concept of the turing test, because our mind is shaped by our experiences. Also, I think your conception of LLM limitations is mistaken. We don’t fully understand them in theory- but I think the way to think of LLMs is that they are a probablistic world model able to simulate almost any scenario if setup properly. They are not themselves a mind, but if sufficiently good, they will simulate minds- and those simulated minds are actually minds but not human minds. Noam Chomsky published an article arguing how LLMs were incapable even in theory of doing things GPT4, which was released shortly after his article can do- showing that either his model of what they are, or of what is required for those tasks is mistaken. Ironically his way of thinking involves failing to understand that intelligent minds vastly different than human minds are even possible- while expecting AI to be able to not just understand but correctly navigate that situation.