2 ms·
> We adopt a two-player implementation of the Turing Test, where an interrogator asks questions of a single witness and must decide if they are human or an AI.
by skybrian 3y ago
> We adopt a two-player implementation of the Turing Test, where an interrogator asks questions of a single witness and must decide if they are human or an AI. This differs from Turing’s original three-person formulation, but obviates the need to have multiple human participants online for each game.
So, not actually a Turing test. A real Turing test is much harder, because the humans (if they've practiced) can try to coordinate, sort of like playing Werewolf.
See my blog post: https://skybrian.substack.com/p/done-right-a-turing-test-is-a-difficult https://skybrian.substack.com/p/done-right-a-turing-test-is-...
- camrobjones 3y agoThanks for pointing this out, we do discuss it briefly in section 4.2, but I like your analysis in the blog! Since the models are not passing, we didn't think it was a huge issue. If models are consistently passing the 2-person version, I think the motivation for running a (more cumbersome) 3-person version would be a lot stronger.