4 ms·

Are we ready yet to admit Turing test has been passed?

paxys 2y ago
The Turing Test (which involves fooling a human into thinking they are talking to another human rather than a computer) has been routinely passed by very rudimentary "AI" since as early as 1991. It has no relevance today.
- adverbly 2y ago
  This is only true for some situations. In some test conditions it has not been passed. I can't remember the exact name, but there used to be a competition where PhD level participants blindly chat for several minutes with each other and are incentivized to discover who is a bot and who is a human. I can't remember if they still run it, but that bar has never been passed from what I recall.
rvz 2y ago
LLMs have already beaten the Turing test. It's useless to use it when OpenAI and others are aiming for 'AGI'. So you need a new Turing test adapted for AGI or a totally different one to test for AGI rather than the standard obsolete Turing test.
- riku_iki 2y ago
  > LLMs have already beaten the Turing test. I am wondering where this happened? In some limited scope? Because if you plug LLM into some call center role for example, it will fall apart pretty quickly.
TillE 2y ago
Extremely basic agency would be required to pass the Turing test as intended. Like, the ability to ask a new unrelated question without being prompted. Of course you can fake this, but then you're not testing the LLM as an AI, you're testing a dumb system you rigged up to create the appearance of an AI.
- flockonus 2y ago
  > Turing proposed that a human evaluator would judge natural language conversations between a human and a machine designed to generate human-like responses. The evaluator would be aware that one of the two partners in conversation was a machine, and all participants would be separated from one another. The conversation would be limited to a text-only channel, such as a computer keyboard and screen, so the result would not depend on the machine's ability to render words as speech. I don't see agency mentioned or implied anywhere: https://en.wikipedia.org/wiki/Turing_test https://en.wikipedia.org/wiki/Turing_test What definition or setup are you taking it from?

The Turing Test (which involves fooling a human into thinking they are talking to another human rather than a computer) has been routinely passed by very rudimentary "AI" since as early as 1991. It has no relevance today.

adverbly 2y ago
This is only true for some situations. In some test conditions it has not been passed. I can't remember the exact name, but there used to be a competition where PhD level participants blindly chat for several minutes with each other and are incentivized to discover who is a bot and who is a human. I can't remember if they still run it, but that bar has never been passed from what I recall.

rvz 2y ago

LLMs have already beaten the Turing test. It's useless to use it when OpenAI and others are aiming for 'AGI'. So you need a new Turing test adapted for AGI or a totally different one to test for AGI rather than the standard obsolete Turing test.

riku_iki 2y ago
> LLMs have already beaten the Turing test. I am wondering where this happened? In some limited scope? Because if you plug LLM into some call center role for example, it will fall apart pretty quickly.

TillE 2y ago

Extremely basic agency would be required to pass the Turing test as intended. Like, the ability to ask a new unrelated question without being prompted. Of course you can fake this, but then you're not testing the LLM as an AI, you're testing a dumb system you rigged up to create the appearance of an AI.

flockonus 2y ago
> Turing proposed that a human evaluator would judge natural language conversations between a human and a machine designed to generate human-like responses. The evaluator would be aware that one of the two partners in conversation was a machine, and all participants would be separated from one another. The conversation would be limited to a text-only channel, such as a computer keyboard and screen, so the result would not depend on the machine's ability to render words as speech. I don't see agency mentioned or implied anywhere: https://en.wikipedia.org/wiki/Turing_test https://en.wikipedia.org/wiki/Turing_test What definition or setup are you taking it from?