5 ms·
Watson's defeat of top Jeopardy! players, while an impressive feat of natural language processing, is not as impressive as a defeat of a grand master, for one r
by baddox 16y ago
Watson's defeat of top Jeopardy! players, while an impressive feat of natural language processing, is not as impressive as a defeat of a grand master, for one reason.
The reason is that when multiple contestants know the correct response in Jeopardy!, it all comes down to reflexive timing. It's no surprise that a computer could buzz in faster than a human being, and there's no evidence that Watson knows more correct responses than the human competitors.
- deleted 16y ago[deleted]
- DonnyV 16y agoI don't think you fully understand what is going on here. Watson will Process the slang in the sentence, figure out how the words are being used, understand the context of the question and then look through its internal databases to see if it can piece different pieces of knowledge that it has to come up with an answer. THATS FUCKING HUGE!!!
- baddox 16y agoWhat led you to believe that I don't understand what's going on? I definitely understand and appreciate IBM's accomplishment. I'm not minimizing the coolness of Watson being able to come up with so many correct responses, I'm minimizing the importance of its actual Jeopardy! gameplay. I'm not sure you understand the real game mechanics of Jeopardy! With highly proficient contestants, it comes down to being able to buzz in as soon as the light turns on indicating that the clue has been delivered by the host. All three contestants know the correct responses to most clues, and it really does come down to the buzzer reflexes, something Watson clearly has a huge advantage in. Again, I fully understand and appreciate what an advance in natural language processing and sheer computation Watson represents. Even being able to match a below-average human Jeopardy! contestant would be impressive. However, the true game-winning technique in Jeopardy! (when all three contestants are highly skilled) is buzzer reflexes.
- azakai 16y agoI think you are exactly right. Other commenters seem to be misunderstanding you. It's clear that this is a huge achievement. However, it is different than a computer beating the human chess champion. All this will prove is that a computer is about the same as the best humans, not strictly better than them. (And, that it is strictly better at timing its buzzer response, which is completely not impressive for a machine to excel at.)
- PakG1 16y agoI'd be curious in knowing the mean response time of Watson. That would shed some light on the topic.
- kenjackson 16y agoBut you still give Watson too little credit here. You have typically 3s from when the "answer" is shown to when you can click the buzzer. So in 3s Watson has to go through all of its databases and semantic links and formulate the question, from an answer that often doesn't even make sense to probably half of the US population. That's pretty impressive.
- baddox 16y agoI understand and appreciate what Watson is doing. It's awesome and ground-breaking. However, with contestants of this skill level, most of the responses will be known by all contestants, and the real competition is how fast you can buzz in after the light turns on indicating the clue has been completed. Think of it this way: if you had a human standing in Watson's spot, with a monitor displaying Watson's suggested response, I don't think that human would perform as well against the other human contestants. Sure, Watson would often come up with the correct response while the clue was being spoken by the host, but the human would still have to buzz in when the light turns on. If you buzz in too early, you get locked out for something like a quarter of a second. Watson would still be extremely awesome technology, but I don't think a human with access to Watson's output would compete at anywhere near the level that Watson did in the video.
- kenjackson 16y agowith contestants of this skill level Do you see what you're saying.. "contestants of this skill level"? It's Ken Jennings, Brad Rutter, and WATSON. Discussion over. The fact that there is a computer that can answer questions in 3s that put it at the level of the two greatest trivia players in history is THE story. Some jeopardy answers: Anagramed Animals -- A furry little pet: the rams Some say the Bush administration's domestic spying conflicts with FISA, the Foreign Intelligence this Act "R"2"D"2 -- More rubicund Half the people in the US probably couldn't answer any of these at all, much less necessarily even know what the answer was referring to, period. The fact that the computer may have an advantage at pressing the buzzer against the two best buzzer pushers of all time is a pretty small deal. IMHO. :-)
- amalcon 16y agoIf Deep Blue had tied Kasparov, it would still have been a tremendous achievement. I'd say the victory was only minimally more impressive.
- johanbev 16y agoThe main difference between chess and Jeopardy is that Watson has to interpret ambigous (and awkwardly presented) "answers" and interpret what will be a suitable "question" to that. Both these two are really difficult. Watson needs a lot of natural language understanding across all lingusitic domains to even be able to search its databases and rule engines and what have you. Chess, in contrast, is a totally deterministic game and the game state can easily be fed into a computer. That computers are able to beat humans at that comes as no surprise.
- SeanDav 16y agoHuman reflexes, when ready for a signal can respond easily with 0.2 of a second and often much faster, this is the sum total of the advantage that Watson has. This is irrelevant, what matters is that Watson has probably reached the stage where it can compete with the best of humans in a game involving abstract reasoning and natural language processing and do it fast enough where people can start arguing about fractions of a second!