5 ms·
Creators: Watson has no speed advantage as it crushes humans in Jeopardy
- zach 16y agoWell, opinions differ then, because Ken Jennings said halfway through an NPR interview yesterday Watson has the "advantage of speed which no human reflexes can match." Plus, come on, everyone who watched the match so far knows they're just trying to put some spin on this. The reason why humans don't wait for the light is because their nervous systems are too slow! Watson doesn't have that problem. If timing and rhythm were so important, they would have Watson do that too. But we all know they don't need to.
- markszcz 16y agoSpeaking of reflexes, it reminds me of those games where your supposed to click/hit a button once it says go. I did a quick search and found this pretty simple flash reaction game: http://www.opendb.net/media/content/426.swf http://www.opendb.net/media/content/426.swf Best I could do was .26 seconds =/ I bet someone with a Lego Mindstorm set could whip up a robot that would do this much faster.
- hackernews 16y agoGot .03 here But that was after I figured out that you could just continually click the button and score much lower. Advantage humans.
- gregpilling 16y agoYou should have kept trying. I got .01 second by using your technique. http://i.imgur.com/PG92y.jpg http://i.imgur.com/PG92y.jpg . I recently had to go to a nerve specialist and we talked about the speed of the electrical pulses that go through your body. He told me that it is nowhere near the speed of electricity in wire - more on the order of meters per second, not miles per second.
- bobf 16y agoThe reaction timer was interesting -- I managed to get 0.16s in one attempt out of ~15, with most attempts ranging from .25-.35. It reminded me of exercises they had us do in driver's ed in high school to show how reaction time+braking distance was affected by alcohol.
- afrodanskeren 16y agoNice timer. I managed to hover around .25 by staring at the background color rather than the button itself. Unsettling to notice the time gap between my brain perceiving the color change and moving the finger/clicking.
- evo_9 16y agoI think the bigger issue is the fact that they 'feed' Watson the question via a text file. That was probably the most (only?) disappointing thing they revealed. It would seem that voice-recognition is far enough along where that shouldn't be necessary. Maybe adding that would delay Watson just enough to seem far? Or perhaps I'm over simplifying the difficulties of adding voice recognition to Watson?
- ianferrel 16y agoThe interesting question is whether the computer can do natural language processing, not whether it can recognize spoken words. Even the human contestants don't rely on the host reading the questions; they read the board. I guess you could argue that Watson should do OCR of the board, but that's not actually a hard problem, so it wouldn't really add much to the challenge. They're focusing on language processing, not environmental sensors.
- evo_9 16y agoRight, perfect - that is actually more fundamental and exactly what I was getting at. Is the game currently fair? It's hard to say but watching it seems like there is an advantage there for Watson. I do like the way Jennings downplayed it though. I think he was being almost too kind but compared to how Kasporov handled himself, this is hugely better.
- arctangent 16y agoI haven't seen the video yet but I think the facts will show that the game is reasonably fair, given the different species participating. Whether or not there is an advantage for Watson is, I suppose, rather the point of the exercise ;-)
- Qz 16y agoOf course it's not fair. The question is whether Watson's advantages are offset by its disadvantages.
- sp332 16y ago
- cma 16y agoHere's the meat: "They're not waiting for the light to come on," Welty said; rather, the human players try to time their buzzer presses so that they're coming in as close as possible to the light. Though Watson's reaction times are faster than a human, Welty noted that Watson has to wait for the light. Dr. Adam Lally, another member of Watson's team, noted that "Ken and Brad are really fast. They have to be." What a deceptive little statement. If you set the "attempt answer" bit in Watson before the light comes on, and you have the humans attempt to press it as soon as allowable, they will never beat Watson. Actually, they may beat him a few times per hundred-thousand attempts (assuming Watson gets the "light" and buzzes in via tens-of-microseconds-scale ethernet), but would have to be willing to tolerate what would normally be an unacceptable error rate (if you press early, you can't press again for ~2 seconds if I remember right).
- naveensundar 16y agoIf you set the "attempt answer" bit in Watson before the light comes on, and you have the humans attempt to press it as soon as allowable, they will never beat Watson. There were at least a couple of questions for which Watson had 90%+ confidence for the right answer and also way above its buzz threshold but could not buzz in.
- markszcz 16y agoHeres one with 65% confidence: http://www.youtube.com/watch?v=HR2_M8kL_3o&t=3m58s http://www.youtube.com/watch?v=HR2_M8kL_3o&t=3m58s 97% confidence: http://www.youtube.com/watch?v=HR2_M8kL_3o&t=4m26s http://www.youtube.com/watch?v=HR2_M8kL_3o&t=4m26s
- deleted 16y ago[deleted]
- cma 16y agoWatson doesn't decide instantaneously; did it pass its buzz threshold before or after the 'light' went on?
- gojomo 16y ago
- there 16y agoi wish watson had to do speech/text recognition of the answers. it would slow down watson's response and put it on par with the human contestants who don't have the answers hard-wired directly into their brains and still have to spend time reading or listening to alex.
- MichaelGG 16y agoI doubt that OCR on the nicely formatted question screen would slow it down appreciably.
- flatline 16y agoI suspect they could have done this, the technology certainly exists to read the screens and parse text from an image. They could also have tried to recognize when a human gives a wrong answer, like with the 20's question, and presumably the same logic used to play Jeopardy could interpret that statement and not give the same answer again. Watson took four years to develop and is the first of its kind. I suspect that something fancier never would have been finished, and too many features would have been a distraction from what IBM has actually accomplished.
- doty 16y agoNo, it wouldn't. At the highest levels of play, all players know most answers, and are prepared to ring in as soon as the capability to ring in is given to them. In other words, at this level of play, all humans are racing for the buzzer. The fact that Watson may know the answer before the contestants are allowed to ring in is not an actual advantage for Watson. (The mechanical button-pushing device is.)
- locopati 16y agoOne thing I haven't seen mentioned is that Watson is going to be consistent for the whole match. A human is going to vary in response time if their attention drifts just a little or their hand slows (maybe an itch, maybe a cramp).