4 ms·

Seems pretty close to passing for me. Certainly if I was just playing with it myself it wouldn't have occurred to me to ask it gibberish questions, and I'd have

Seems pretty close to passing for me. Certainly if I was just playing with it myself it wouldn't have occurred to me to ask it gibberish questions, and I'd have thought it was a person. It gets things wrong that people might get wrong too. Here's one you probably heard: Quickly answer the following. What color is a fridge? What does a cow drink? Cows don't drink milk. But many people will say milk, perhaps because they are primed by association. Also, part of me thinks NOT getting math right is more of a Turing test pass than getting it right immediately. It's pretty easy to think of a calculation that no person could do in their head, but a machine could either find or calculate in a second. It's kinda like how you might put on an accent to fit in with a certain group.

Seabiscuit 6y ago
You would enjoy Saygin et al, (2000) [1] ('Turing test: 50 years later). 'Not getting math right' is part of a classic repertoire of cheap hacks used to pass the Turing test by mimicking 'how' a human might speak. This includes pauses in typing, grammatical errors, fillers such as 'like' and on son in order to pass the TT, instead of building language competency so well that passing the TT is a by-product. It's like 'teaching to the test' instead of teaching the subject. "Some people interpret the TT as a setting in which you can "cheat". The game has no rules constraining the design of the machines. At some places in the paper, Turing describes how machines could be "rigged" to overcome certain obstacles proposed by opponents of the idea that machines can think. "A very obvious example is about machines making mistakes. When the machine is faced with an arithmetical operation, in order not to give away its identity by being fast and accurate, it can pause for about 30 seconds before responding and occasionally give a wrong answer. Being able to carry out arithmetical calculations fast and accurately is generally considered intelligent behavior. However, Turing wishes to sacrifice this at the expense of human-ness. "Some commentators think this is "cheating". The machine is resorting to certain "tricks" in its operations rather than imitating the human ways. However, arithmetic is a highly specific domain. Modifying the programs in this manner cannot hurt: If a machine can pass the test, it can then be re-programmed not to cheat at arithmetic. If it does not resort to this, the interrogator can ask a difficult arithmetical problem as his/her first question and decide that he/she is dealing with a machine right then and there." [1]: Saygin, A. P., Cicekli, I., & Akman, V. (2000). Turing test: 50 years later. Minds and machines, 10(4), 463-518.
- thom 6y ago
  I’d personally be interested in a form of test that didn’t allow these sorts of side-channel attacks. Submit a test script, get answers back some time in the future, do a few iterations to dig down into answers maybe. Would rather people’s time not be wasted on irrelevant stuff.
compsciphd 6y ago
calfs don't drink milk? I'd think milk (and water obviously) would be a safe answer for all mammals
- StavrosK 6y ago
  Cows are the adult animals, after they've had calves. They're called heifers before that.
  - catalogia 6y ago
    That might be technically correct, but that's not how I've ever used the terms. I've always considered calves to be baby cows, with the term cow broadly applying to all cattle, not just adult cattle.

Seabiscuit 6y ago

You would enjoy Saygin et al, (2000) [1] ('Turing test: 50 years later). 'Not getting math right' is part of a classic repertoire of cheap hacks used to pass the Turing test by mimicking 'how' a human might speak. This includes pauses in typing, grammatical errors, fillers such as 'like' and on son in order to pass the TT, instead of building language competency so well that passing the TT is a by-product. It's like 'teaching to the test' instead of teaching the subject. "Some people interpret the TT as a setting in which you can "cheat". The game has no rules constraining the design of the machines. At some places in the paper, Turing describes how machines could be "rigged" to overcome certain obstacles proposed by opponents of the idea that machines can think. "A very obvious example is about machines making mistakes. When the machine is faced with an arithmetical operation, in order not to give away its identity by being fast and accurate, it can pause for about 30 seconds before responding and occasionally give a wrong answer. Being able to carry out arithmetical calculations fast and accurately is generally considered intelligent behavior. However, Turing wishes to sacrifice this at the expense of human-ness. "Some commentators think this is "cheating". The machine is resorting to certain "tricks" in its operations rather than imitating the human ways. However, arithmetic is a highly specific domain. Modifying the programs in this manner cannot hurt: If a machine can pass the test, it can then be re-programmed not to cheat at arithmetic. If it does not resort to this, the interrogator can ask a difficult arithmetical problem as his/her first question and decide that he/she is dealing with a machine right then and there." [1]: Saygin, A. P., Cicekli, I., & Akman, V. (2000). Turing test: 50 years later. Minds and machines, 10(4), 463-518.

thom 6y ago
I’d personally be interested in a form of test that didn’t allow these sorts of side-channel attacks. Submit a test script, get answers back some time in the future, do a few iterations to dig down into answers maybe. Would rather people’s time not be wasted on irrelevant stuff.

compsciphd 6y ago

calfs don't drink milk? I'd think milk (and water obviously) would be a safe answer for all mammals

StavrosK 6y ago
Cows are the adult animals, after they've had calves. They're called heifers before that.
- catalogia 6y ago
  That might be technically correct, but that's not how I've ever used the terms. I've always considered calves to be baby cows, with the term cow broadly applying to all cattle, not just adult cattle.