4 ms·

I see a World Turing Championship in the future. Half of participants are humans, the other half is AIs. After a series of matches - each consisting of opponent

• jobigoud 6y ago
  I can see the plot twist from there, where the protagonist was in fact not a human all along :-) It's interesting that in such a setup, all participants must pretend to be judges. I've always felt uncomfortable that the Turing test is rewarding good lying. The AI must lie to pass. But developing judge AI is very interesting I think. Even in your setup, immediately, the Judge-side winner is not guaranteed to be a human, since each match results in an evaluation of both sides and AIs can be trained to detect other AIs. And obviously once we have one that is very good at judging, we can fold it over itself for self-improvement. Actually I wonder if being a good Turing test judge is an easier goal than passing the Turing test itself. All you need is come up with interesting questions and understand enough of the answers to make a judgment. It should be relatively easy to create this dataset by combining GPT-3 turing test and Mechanical turk turing tests. Can AI beat humans at this task before we have full AGI? A while ago someone posted a Show HN thread where you would be matched with 50% probability with a human or AI and you could ask questions to guess which. In reality there was no AI, it was all humans vs humans, and they were harvesting Turing test questions!