4 ms·
Alas, my somewhat-skeptical question came in late and got little support: http://www.reddit.com/r/IAmA/comments/fnfg3/by_request_we_are_the_ibm_research_team_t
by gojomo 16y ago
Alas, my somewhat-skeptical question came in late and got little support:
http://www.reddit.com/r/IAmA/comments/fnfg3/by_request_we_are_the_ibm_research_team_that/c1h90u4 http://www.reddit.com/r/IAmA/comments/fnfg3/by_request_we_ar...
What determined the use of exactly 10 racks of 9 maxed-out (32-core, 512GB RAM) 4U Power750 servers? For example, would Watson have done better with more hardware? Or could it have made-do with far less, after all the bulk pre-processing of, and training on, source material was finished?
(My intuitions about the necessary amount of reference data and topical associations – written up at http://redd.it/fnixm http://redd.it/fnixm – made me think way less hardware should have been required, at least at the very end during the match.)
- whatusername 16y agoTony Pearson wrote a bunch of stuff about Watson. https://www.ibm.com/developerworks/mydeveloperworks/blogs/InsideSystemStorage/entry/ibm_watson_how_to_build_your_own_watson_jr_in_your_basement7?lang=en https://www.ibm.com/developerworks/mydeveloperworks/blogs/In... Had a bunch of details including some performance details... Single core -- 1 -- 2 hours Single IBM Power750 server -- 32 -- < 4 minutes Single rack (10 servers) -- 320 -- < 30 seconds IBM Watson (90 servers) -- 2,880 -- < 3 seconds https://www.ibm.com/developerworks/mydeveloperworks/blogs/InsideSystemStorage/entry/watson_what_is_the_smartest_machine_on_earth7?lang=en https://www.ibm.com/developerworks/mydeveloperworks/blogs/In... Had details on the data/storage/ram: When Watson is booted up, the 15TB of total RAM are loaded up, and thereafter the DeepQA processing is all done from memory. According to IBM Research, "The actual size of the data (analyzed and indexed text, knowledge bases, etc.) used for candidate answer generation and evidence evaluation is under 1TB." For performance reasons, various subsets of the data are replicated in RAM on different functional groups of cluster nodes. The entire system is self-contained, Watson is NOT going to the internet searching for answers.
- blhack 16y agoI wonder if this is marketing. IBM makes BIG HUGE MASSIVE (tm) server clusters that have lots of blinkenlights and require lots of power and are so crazy and huge and awesome that the people working at IBM must be hyper-geniuses! vs Watson runs on a laptop.
- brisance 16y agoI can't see how that would be marketing. Most people would be more impressed if Watson could run on a laptop, today. I know I would.
- gojomo 16y agoMore impressed? Yes. More willing to spend millions on hardware and software? No.
- wtallis 16y agoI can see IBM charging customers millions a year to keep their Watson database up to date, even if it ends up running on an x86 Linux box. When they adapt it for general Q&A use, Watson will probably be as useful as Wolfram Alpha wishes it was.
- brisance 16y agoAnd how would they look if, as the original poster surmised, it were possible for a competitor to produce something similar to Watson on today's laptop? IBM would've spent millions of dollars making themselves look very silly. It's a similar situation to moon-landing skepticism. If it didn't happen, it would be trivial for the Soviet Union to disgrace and discredit the achievement by faking their own.
- gojomo 16y agoNo other team was given a crack at the Jeopardy spotlight. IBM didn't win against a bunch of other teams for the slot on the human/machine faceoff; it was all orchestrated for them. So give others some time to emerge. I suspect in a year or two – perhaps sooner, if an organized open competition with real cash prizes is launched – we'll have a better idea of what a lean team could do on the trivia domain. It may not be reduced to a single 2011-equivalent laptop... but it might be a single 2011-equivalent maxed-out-server (rather than a Watson-like server room).
- blhack 16y ago