7 ms·

Where did the 30% requirement come from? Sounds like something the contest organizers added to make it possible to "pass" without fooling 2/3 of the judges. Usi

Where did the 30% requirement come from? Sounds like something the contest organizers added to make it possible to "pass" without fooling 2/3 of the judges. Using a young teenager as a character also seems like a cheat unless they had other 13-year olds to be the judges. The character needs to be a peer to the judges. Most 13 year olds behave oddly enough in the opinion of most adults that it's got to be easier to credit weird behavior to generational or cultural differences. So kudos to the winners on strategy, and boo to the contest organizers for having such poor rules.

KwanEsq 12y ago
Most likely from here: >It will simplify matters for the reader if I explain first my own beliefs in the matter. Consider first the more accurate form of the question. I believe that in about fifty years' time it will be possible, to programme computers, with a storage capacity of about 109, to make them play the imitation game so well that an average interrogator will not have more than 70 per cent chance of making the right identification after five minutes of questioning. COMPUTING MACHINERY AND INTELLIGENCE — A. M. Turing http://loebner.net/Prizef/TuringArticle.html http://loebner.net/Prizef/TuringArticle.html
- Buge 12y ago
  Is he talking about 109 bits? Because that seems pretty impossible to me.
  - ar7hur 12y ago
    More likely 1E9
  - DanBC 12y ago
    > As we have mentioned, digital computers fall within the class of discrete-state machines. But the number of states of which such a machine is capable is usually enormously large. For instance, the number for the machine now working at Manchester is about 2 165,000, i.e., about 10 50,000. Compare this with our example of the clicking wheel described above, which had three states. It is not difficult to see why the number of states should be so immense. The computer includes a store corresponding to the paper used by a human computer. It must be possible to write into the store any one of the combinations of symbols which might have been written on the paper. For simplicity suppose that only digits from 0 to 9 are used as symbols. Variations in handwriting are ignored. Suppose the computer is allowed 100 sheets of paper each containing 50 lines each with room for 30 digits. Then the number of states is 10 100x50x30 i.e., 10 150,000 . This is about the number of states of three Manchester machines put together. The logarithm to the base two of the number of states is usually called the "storage capacity" of the machine. Thus the Manchester machine has a storage capacity of about 165,000 and the wheel machine of our example about 1.6. If two machines are put together their capacities must be added to obtain the capacity of the resultant machine. This leads to the possibility of statements such as "The Manchester machine contains 64 magnetic tracks each with a capacity of 2560, eight electronic tubes with a capacity of 1280. Miscellaneous storage amounts to about 300 making a total of 174,380."
  - BenMQ 12y ago
    Indeed it should be 10^9. Likely an OCR error - you can find several other 10^9 properly formatted somewhere else in the paper.
  - MaysonL 12y ago
    That's almost certainly meant to be 10 to the 9th.
  - DanBC 12y ago
    And don't forget that the word bit was only around two years old at the time the paper was written. (I have no idea when Tukey first suggested it. I'm using Shannon's publication for a date.) 10^9 bits is only (check my math) about 120 MBytes. So Turing was perhaps a bit optimistic there?
ronaldx 12y ago
You can also pass the test this way by having "generous" judges contributing to the 1/3, which is likely because the judges are not impartial: they are emotionally invested in being part of a positive result. I wonder how Kevin Warwick himself voted, for example. A more correct test (which admittedly doesn't cover this issue) would be to give each judge a conversation with one human and one computer, and for them to say which one they believe is the human.
- thisjepisje 12y ago
  >to give each judge a conversation with one human and one computer, and for them to say which one they believe is the human. I always assumed this was exactly what the Turing test was about. Guess I was wrong.
  - andreasvc 12y ago
    This is indeed what the Turing test as originally proposed is about.
mcguire 12y ago
30% of the time, five minute conversations, a "simulated" 13-year old? At least "the conversations were unrestricted". The Turing test is not a test. Instead, it is an operational definition of "intelligence", a very slight formalization of the idea that something is intelligent if it seems to be intelligent. As a test, it obviously has to have some kind of limits like this "competition", but as soon as you put limits on it then it stops being useful and becomes both gameable and meaningless. The Turing test has already been passed, long ago, if you have limits suitable to the Doctor or Parry.
- TillE 12y ago
  > Instead, it is an operational definition of "intelligence" Exactly. It's a straightforward formulation of what a strong AI would be capable of. It makes no sense to have a restricted Turing test that can be passed by a useless chatbot. It means absolutely nothing.
  - lukeschlather 12y ago
    Not at all. If you've been following this, the age of the test has been getting older and older for the past 15 or so years. They're not resting on their laurels at 13-year-old, next year maybe they'll make 14, and the year after that... It's a way of having a better metric than pass/fail. This is the real problem with AI. Everyone expects that AI research should go: you put a bunch of programmers in a room, and they work for a few years and build an AI. The best intelligence production we have is human child-rearing. This process has always taken 15-20 years, and is backed by millennia of research. Assume you have a digital computer capable of human-like thought. Without an example of a computer capable of learning faster, it stands to reason that raising the computer into an AI capable of conversation should take 15-20 years. Of course, one thinks there would be a way to do it faster, but on the first go?
  - andreasvc 12y ago
    I assume you mean weak AI. And I don't see how you can dismiss the meaning of passing this test so easily. Although it's a trivial example, I can definitely see such chatbots being applied for spamming purposes, which by definition exploits hapless victims.
Nimi 12y ago
A blogspam linking to this page also claimed the alleged "boy" was described as a Russian boy to whom English is a second language. The official report from University of Reading doesn't mention this, can anyone shed more light on this? http://gizmodo.com/this-is-the-first-computer-in-history-to-have-passed-th-1587780232 http://gizmodo.com/this-is-the-first-computer-in-history-to-...

KwanEsq 12y ago

Most likely from here: >It will simplify matters for the reader if I explain first my own beliefs in the matter. Consider first the more accurate form of the question. I believe that in about fifty years' time it will be possible, to programme computers, with a storage capacity of about 109, to make them play the imitation game so well that an average interrogator will not have more than 70 per cent chance of making the right identification after five minutes of questioning. COMPUTING MACHINERY AND INTELLIGENCE — A. M. Turing http://loebner.net/Prizef/TuringArticle.html http://loebner.net/Prizef/TuringArticle.html

Buge 12y ago
Is he talking about 109 bits? Because that seems pretty impossible to me.
- ar7hur 12y ago
  More likely 1E9
- DanBC 12y ago
  > As we have mentioned, digital computers fall within the class of discrete-state machines. But the number of states of which such a machine is capable is usually enormously large. For instance, the number for the machine now working at Manchester is about 2 165,000, i.e., about 10 50,000. Compare this with our example of the clicking wheel described above, which had three states. It is not difficult to see why the number of states should be so immense. The computer includes a store corresponding to the paper used by a human computer. It must be possible to write into the store any one of the combinations of symbols which might have been written on the paper. For simplicity suppose that only digits from 0 to 9 are used as symbols. Variations in handwriting are ignored. Suppose the computer is allowed 100 sheets of paper each containing 50 lines each with room for 30 digits. Then the number of states is 10 100x50x30 i.e., 10 150,000 . This is about the number of states of three Manchester machines put together. The logarithm to the base two of the number of states is usually called the "storage capacity" of the machine. Thus the Manchester machine has a storage capacity of about 165,000 and the wheel machine of our example about 1.6. If two machines are put together their capacities must be added to obtain the capacity of the resultant machine. This leads to the possibility of statements such as "The Manchester machine contains 64 magnetic tracks each with a capacity of 2560, eight electronic tubes with a capacity of 1280. Miscellaneous storage amounts to about 300 making a total of 174,380."
- BenMQ 12y ago
  Indeed it should be 10^9. Likely an OCR error - you can find several other 10^9 properly formatted somewhere else in the paper.
- MaysonL 12y ago
  That's almost certainly meant to be 10 to the 9th.
- DanBC 12y ago
  And don't forget that the word bit was only around two years old at the time the paper was written. (I have no idea when Tukey first suggested it. I'm using Shannon's publication for a date.) 10^9 bits is only (check my math) about 120 MBytes. So Turing was perhaps a bit optimistic there?

ronaldx 12y ago

You can also pass the test this way by having "generous" judges contributing to the 1/3, which is likely because the judges are not impartial: they are emotionally invested in being part of a positive result. I wonder how Kevin Warwick himself voted, for example. A more correct test (which admittedly doesn't cover this issue) would be to give each judge a conversation with one human and one computer, and for them to say which one they believe is the human.

thisjepisje 12y ago
>to give each judge a conversation with one human and one computer, and for them to say which one they believe is the human. I always assumed this was exactly what the Turing test was about. Guess I was wrong.
- andreasvc 12y ago
  This is indeed what the Turing test as originally proposed is about.

mcguire 12y ago

30% of the time, five minute conversations, a "simulated" 13-year old? At least "the conversations were unrestricted". The Turing test is not a test. Instead, it is an operational definition of "intelligence", a very slight formalization of the idea that something is intelligent if it seems to be intelligent. As a test, it obviously has to have some kind of limits like this "competition", but as soon as you put limits on it then it stops being useful and becomes both gameable and meaningless. The Turing test has already been passed, long ago, if you have limits suitable to the Doctor or Parry.

TillE 12y ago
> Instead, it is an operational definition of "intelligence" Exactly. It's a straightforward formulation of what a strong AI would be capable of. It makes no sense to have a restricted Turing test that can be passed by a useless chatbot. It means absolutely nothing.
- lukeschlather 12y ago
  Not at all. If you've been following this, the age of the test has been getting older and older for the past 15 or so years. They're not resting on their laurels at 13-year-old, next year maybe they'll make 14, and the year after that... It's a way of having a better metric than pass/fail. This is the real problem with AI. Everyone expects that AI research should go: you put a bunch of programmers in a room, and they work for a few years and build an AI. The best intelligence production we have is human child-rearing. This process has always taken 15-20 years, and is backed by millennia of research. Assume you have a digital computer capable of human-like thought. Without an example of a computer capable of learning faster, it stands to reason that raising the computer into an AI capable of conversation should take 15-20 years. Of course, one thinks there would be a way to do it faster, but on the first go?
- andreasvc 12y ago
  I assume you mean weak AI. And I don't see how you can dismiss the meaning of passing this test so easily. Although it's a trivial example, I can definitely see such chatbots being applied for spamming purposes, which by definition exploits hapless victims.

Nimi 12y ago

A blogspam linking to this page also claimed the alleged "boy" was described as a Russian boy to whom English is a second language. The official report from University of Reading doesn't mention this, can anyone shed more light on this? http://gizmodo.com/this-is-the-first-computer-in-history-to-have-passed-th-1587780232 http://gizmodo.com/this-is-the-first-computer-in-history-to-...