5 ms·
Watson is amazing, but I've known for years that it was coming. You just have to look at Google and Wikipedia to know that it was coming. Because answering triv
by mechanical_fish 16y ago
Watson is amazing, but I've known for years that it was coming. You just have to look at Google and Wikipedia to know that it was coming. Because answering trivia questions is just not the equivalent of passing the Turing test. Trivia questions are quite guessable.
I played a lot of College Bowl (and its local high-school equivalent) back in my younger days. And there were many running gags about the strategy. For example, if a question contained the words "Name this artist..." there was a strictly limited set of possible answers, defined roughly as "artists whose names appear in a typical high school art appreciation class". Similarly, "name this composer" is more likely to be cluing Beethoven or Bach or Mozart than Grieg or Saint-Saens, and almost certainly not anybody more obscure than that. And Grieg is not that obscure.
There were a lot of common themes: It was a good idea to memorize the names of all the Greek, Roman, and Norse gods; the names of all the types of clouds; the capitals of countries and the names of political leaders. That sort of thing.
In College Bowl (unlike Jeopardy) it is legal to press the buzzer and interrupt the questioner at any point. The questioner just stops reading until you've taken your guess. And so every College Bowl geek knows a story like this: Someone accidentally presses the buzzer before the person reading the questions has said more than one or two words. So, with nothing else to do but guess, the player shouts something out. And that guess is correct.
I've never seen a zero-word guess work in person, but I've seen a few two and three-word guesses succeed. Given just a hint of the topic ("this scientist...") the odds are surprisingly good. The search space is just not that large.
One reason why trivia is easy is that questions that require even the smallest amount of actual thought tend to be too ambiguous for good trivia. Trivia questions are generally read, answered, and judged by people who have no actual expertise in their subject matter, so it's important that the answers be very clear and unambiguous. I used to dread the physics questions, because I was a student physicist, and I understood the questions too well. So it was sometimes difficult to avoid giving answers that were technically correct, but that did not match the one on the card.
- andrewce 16y agoMy college didn't have a college bowl team, but competing on high school teams and being responsible for more than a few correct two or three word answers, I can vouch for this. It's all about having enough breadth that the other bits of information presented can help whittle down answers by way of association and relationships. Good trivia players rely quite a bit on intuition. Ken Jennings mentioned (in his book) how Jeopardy! often has questions about rivers, so it was a fairly simple matter to just memorize river names and some basic associations with which to answer questions. It seems like Watson is mostly a really sophisticated algorithm on top of lots of brute force (2880 processors?!). Though I guess it could also be said that humans are just ugly bags of mostly water. That said: in something like medicine (differential diagnoses), such a system could also be extremely useful, given the frequent occurrence of a fairly limited number of "answers".
- WalterBright 16y agoI had the same thought. I think Watson would make a fabulous resource for medical diagnoses. It also shouldn't just give the "answer", but the top 10 or so matches along with their probabilities.
- nooneelse 16y agoIt could also make a decent living in tech support too.
- mkramlich 16y ago> It seems like Watson is mostly a really sophisticated algorithm on top of lots of brute force (2880 processors?!). Though I guess it could also be said that humans are just ugly bags of mostly water. Arguably Ken Jennings is mostly a really sophisticated algorithm on top of lots of brute force (billions of neurons?). And computers are just pretty blocks of mostly silicon. :)
- kenjackson 16y agoTrivia questions are quite guessable. I think you overestimate human interaction. :-) Look at how many people will have full on conversations with bots. And these aren't even good bots. An IRC based Turing test will be passed in the next 15 years. The corpus that we have with Google/Bing/Wikipedia add to that emails from GMail/Yahoo/Hotmail, IMs and text message, Facebook messages and statuses. The computer will not only be able to have conversation, but it will be able to go from talking to you in the Queen's English to ebonics. And will be the most knowledgeable person you've ever met.