4 ms·
It is certainly unfair and has pretty much ruined the competition for me. Watson can instantly detect when he's allowed to ring in. This is no different than a
by ellyagg 16y ago
It is certainly unfair and has pretty much ruined the competition for me. Watson can instantly detect when he's allowed to ring in. This is no different than a car "racing" a human. In theory, a human contestant can try to time his trigger to coincide with the end of Trebeck speaking the question, and catch the light just as the timing person releases the question, but in practice this is fraught with peril--if you're off you can't ring in for several tenths of a second--and requires much more of a human's energy, which he can no longer devote to figuring out the question. You could see Jennings attempt this on the first day, with mixed results. These episodes are commercials for IBM and it's clear who is supposed to win.
- gloob 16y agoNot certain what's unfair about it - if we accept that the human contestants would have scored comparably to Watson (if they had the opportunity), then the competition really does boil down to who has the fastest thumb. I can't imagine it would be any more entertaining to watch IBM throw the match by intentionally crippling their player.
- baddox 16y agoIt's not unfair exactly, but it certainly ruins the impressiveness of Watson's ability to come up with the right answers. I highly doubt Watson's accuracy is even close to Brad or Ken's, but the buzzer seals the deal. It's less impressive, just like a computer sorting 1000 integers faster than a human is less impressive. edit: added "not" after the first word
- gloob 16y agoFrom the descriptions I've read, Watson only buzzed in after it believed it had a solid answer. If it was significantly less accurate than its competitors, it wouldn't have spent the entire match buzzing in before them. I'm afraid I don't really understand the decision to trivialize the fact that we now have a computer that can answer general-knowledge natural-language queries quickly and about as accurately as a clever person. That's a Big Deal.
- baddox 16y agoFor every single clue, there is an overlay showing Watson's top 3 answers, and it shows whether Watson was confident enough to buzz in. In day 2, I counted only 3 times when Watson had a confident response but was beaten to the buzzer. None of this really minimizes IBM's accomplishment, but it absolutely means this specific presentation (Jeopardy!) lacks weight for those of us who understand what the game dynamics of Jeopardy! are. This is nowhere near as impressive a "man vs. machine" victory as was Deep Blue vs. Kasparov.
- ugh 16y agoEven considering that, I don’t know what exactly makes it less impressive than Deep Blue. Watson correctly knew 84% of the answers in the second round. Looking at past games, that’s very much competitive with humans. To me, this is much more impressive than Deep Blue, even considering the fast reaction times.
- jarin 16y agoHere's the thing, a tiny microchip sorting numbers at a speed that a human can barely comprehend IS impressive. Just like flying through the sky in a metal tube, talking to someone on a different continent in realtime, or converting lightning into high-energy photons and cooking your food with it.
- glhaynes 16y agoWell said. I must say, I don't really relate to the "man vs. machine" narrative here. Maybe it's just because I'm not taking the long view (the one in which the machines inevitably rise up and enslave us? or in which "we" become machines?), but all I see is wonderful positives: as you say, the fact that we can now fly in metal tubes doesn't diminish us as humans for not having wings and jet engines. Look at us humans: we can fly now! I really enjoyed this article from Garry Kasparov in the New York Review of Books. Spoiler: it's [partially] about how the best chess player in the world is a really good human paired with a really good computer. http://www.nybooks.com/articles/archives/2010/feb/11/the-chess-master-and-the-computer/ http://www.nybooks.com/articles/archives/2010/feb/11/the-che... So let's all join hands with the machines and sing Kumbayah ... all watched over by machines of loving grace... of course, yes, this is a medium-term view. The long-term, I suppose, probably belongs to the machines.
- zach 16y agoInstead, the game has been crippled. Watson has to press the button, naturally, but they're not going to require Watson to write out the answer with a pen, of course. And forget about audio clues, much less a picture-based Final Jeopardy clue. I mean, if they had changed the ring-in system to work in a manner befitting a man-versus-machine match, you're telling me that wouldn't be entertaining? I would be fascinated by that match. This one was a letdown.
- ericb 16y agoWatson would likely lose if this was instead of jeopardy, a simple trivia test where contestants were scored for the most correct answers. Thinking about that really calls the contest into question for me. We let the machine off the hook for things people are good at but it is not (understanding speech, reading and vision) but we make no allowance for a machine's ability to press a button faster than humanly possible. If you instead phrased the contest as "machine presses button faster than humans" it doesn't seem impressive.
- gloob 16y agoYour implicit assertion that natural language processing is something "a machine is good at" really calls the rest of your post into question for me. In particular, your demand that the researchers solve half-a-dozen Hard Problems instead of only one seems mildly mean-spirited.
- baddox 16y agoYou're completely right, and I'm sick of people equating minimizing Watson's Jeopardy! success with minimizing the software/hardware accomplishment behind Watson. IBM has done something great here, but the buzzer dynamic renders Watson's Jeopardy! prowess unimpressive. A good analogy, similar to your car vs. human analogy, is this: Hold a competition where two contestants much first pass some sort of Turing-like test. Upon passing that test, both contestants must sort one million 32-bit integers. The first contestant to finish both tasks wins. In that hypothetical competition, it would certainly be impressive for a computer contestant to pass the Turing-like test. (The human contestant would probably have no trouble doing so.) But the sorting task would seal the door, and the computer would win every time it is able to pass the Turing-like test. The sorting task is known to be dominated by computers, just like buzzer reflexes are known to be dominated by computers.
- ugh 16y agoI don’t know what exactly makes Watson’s performance unimpressive. Being able to answer 84% of all questions correctly is impressive, reaction times or not.
- baddox 16y agoAs I've said many times, Watson being able to come up with correct responses that often is impressive. Watson winning Jeopardy! is what's not impressive.