3 ms·
In other words: the Turing test turns out to be too easy.
by dboreham 3y ago
In other words: the Turing test turns out to be too easy.
- kenjackson 3y agoIt's not that it's too easy, but rather AI models are not people. What do I mean by this? There is (for the purposes of this discussion) just one ChatGPT-4 model. This single model has to be all things to all people. It's not Ted. Or Jessica or Dante. You don't expect Jessica to have a reasonable answer to every question. You accept the fact that if you ask Jessica about public schools, she will go off the rails. It's not indictment on all humans -- it's just Jessica. At some point we might have access to a variety of AI models where some will simply say, "I really only know physics pretty well. I prefer not to give my opinon on other topics". And others that will lie about most everything. But we will learn which are useful for what.
- pdonis 3y agoI would put it that most people who think they are applying the Turing test, actually aren't. Part of correctly applying the Turing test is independently checking the statements the test subject makes against your own knowledge. Part of the "thinking" that the test is testing for is checking beliefs against reality, and the Turing test needs to test for that capability, otherwise it's not being done right.
- simonh 3y agoAlso the test is adversarial, it’s not about throwing softballs to a child. The interrogator should have a good understanding of what constitutes intelligence, the kinds of mental faculties humans have, and ask questions that thoroughly test those faculties.