3 ms·

GPT-3 is immensely impressive, and presumably future iterations will be even more so. I'm afraid though that all that GPT or any similar model passing the Turi

GPT-3 is immensely impressive, and presumably future iterations will be even more so. I'm afraid though that all that GPT or any similar model passing the Turing Test would prove is that the Test is not fit for purpose as a demonstration of genuine intelligence - which, to be fair to Turing, is not what it was intended for.

quonn 6y ago
Well, I would say we are learning how such a test really has to look. In a sense it‘s like we are learning what it should look like at a time. Additionally, humans make mistakes, too, especially when they are too lazy to think. Currently the test is still good enough. But in the long term, we should change it to test for transfer learning: Given a new task that is designed to be sufficiently complex and different from known tasks, how well does the AI do? It will require creativity to design those tests. But we‘re still far from that.
- mellosouls 6y ago
  Yes - the Turing Test was intended to further inquiry into what intelligence is; not (as many think) to prove an entity is intelligent. GPT isn't remotely intelligent, just brilliant at producing a semblance of some aspects of intelligence - which the Turing Test is useful in establishing.
  - deleted 6y ago
    [deleted]
magusdei 6y ago
I suppose. But given the constant inflation in what we demand of AI for it to count as "intelligent", it seems that eventually our tests will become so strict that most humans will not be able to pass them.
the8472 6y ago
Arguably humans are not genuinely intelligent most of the time either. But anyway, this can probably be fixed by making the test gamified and adversarial. The machine is considered human-level intelligent when paid testers cannot distinguish paid responders from the AI. Their payment depends on their success rates. Although one potential problem would be collusion between the testers and responders, the next step would allowing the AI access to the communication channels they would use to collude.
- mellosouls 6y ago
  No, that's the point - it would not be considered human level intelligent. It would be considered to have passed the Turing Test is all, which is a very different matter.

quonn 6y ago

Well, I would say we are learning how such a test really has to look. In a sense it‘s like we are learning what it should look like at a time. Additionally, humans make mistakes, too, especially when they are too lazy to think. Currently the test is still good enough. But in the long term, we should change it to test for transfer learning: Given a new task that is designed to be sufficiently complex and different from known tasks, how well does the AI do? It will require creativity to design those tests. But we‘re still far from that.

mellosouls 6y ago
Yes - the Turing Test was intended to further inquiry into what intelligence is; not (as many think) to prove an entity is intelligent. GPT isn't remotely intelligent, just brilliant at producing a semblance of some aspects of intelligence - which the Turing Test is useful in establishing.
- deleted 6y ago
  [deleted]

magusdei 6y ago

I suppose. But given the constant inflation in what we demand of AI for it to count as "intelligent", it seems that eventually our tests will become so strict that most humans will not be able to pass them.

the8472 6y ago

Arguably humans are not genuinely intelligent most of the time either. But anyway, this can probably be fixed by making the test gamified and adversarial. The machine is considered human-level intelligent when paid testers cannot distinguish paid responders from the AI. Their payment depends on their success rates. Although one potential problem would be collusion between the testers and responders, the next step would allowing the AI access to the communication channels they would use to collude.

mellosouls 6y ago
No, that's the point - it would not be considered human level intelligent. It would be considered to have passed the Turing Test is all, which is a very different matter.