3 ms·
> "If your system can have a conversation with a human who believes they're talking to another human afterwards, it's AI, we're not there yet." ==============
by somenameforme 5y ago
> "If your system can have a conversation with a human who believes they're talking to another human afterwards, it's AI, we're not there yet."
==============
[16:31:08] Judge: don't you thing the imitation game was more interesting before Turing got to it?
[16:32:03] Entity: I don't know. That was a long time ago.
[16:33:32] Judge: so you need to guess if I am male or female
[16:34:21] Entity: you have to be male or female
[16:34:34] Judge: or computer
==============
The Turing test you're referencing [1] (transcripts included) was a charade. It seems all participants and organizers were determined to create a scenario where the Turing test could be passed, regardless of whether it actually could or not. Turing's 'test' was never precisely described but he essentially said that after 5 minutes an "interrogator" would not be able to effectively determine whether an AI he was interrogating was a man or a machine.
I'll just list various details on the event, in no particular order:
- Turing specified "interrogators" who would be actively seeking to expose the AI as an AI. The test in question used judges who made no effort whatsoever to challenge the AI frequently asking questions like "How old are you?"
- The judges were not judging an AI but instead having a simultaneous interaction with two entities, and had to pick which was human. Some of the humans seemed to actively make an effort to appear non-human, which paired with judges making no effort to challenge the AI increased the chances of a random result.
- The "AI" that won 'replicated' a 13 year old non-native speaking boy, probably as an excuse for its frequent incoherent responses. Other of its responses were effectively refusing to cooperate or going on complete nonsequiturs which could again be excused for being a 13 year old boy.
- The interactions were limited to 5 minutes with two entities and seemingly slow typing from both the judge and the participants. Some interactions were limited to as few as 2 responses from which to make a decision.
- In the paper itself, the researchers were quite confused why some of the participants and judges behaved the way they did. Obviously they just wanted to be part of something "historic".
- The dialogue I quoted at the top was from a human, obviously trying to trick the judge into misclassifying him as a computer. And it worked, that was one of the 3 misclassifications required to hit their 30% benchmark for passing.
[1] - https://www.tandfonline.com/doi/full/10.1080/0952813X.2015.1055826 https://www.tandfonline.com/doi/full/10.1080/0952813X.2015.1...