The algorithm they used did not exist before 2005. Also since 2005 this algorithm had been mostly trained using just 1 computer at time (usually with gpu's). Th

The algorithm they used did not exist before 2005. Also since 2005 this algorithm had been mostly trained using just 1 computer at time (usually with gpu's). The supercomputer setup is novel for this. Most of the machine learning community had been disregarding this algorithm since 2005, until the past couple of years it started making dramatic showings, such as - Microsoft Research speech recognition system in 2011 (done by one of geoff hinton's students interning there) - NEC labs, ronan collobert - real-time natural languaege parser - first real-time parse ever - 2010 (trained on one computer for 3 months using wikipedia) - Google Research 16,000 node billion connection network - december 2011