That work was impressive -- but kind of over the top. From what I can tell, their dataset could at most have been like 2.5TB uncompressed. Their model took 3 da

That work was impressive -- but kind of over the top. From what I can tell, their dataset could at most have been like 2.5TB uncompressed. Their model took 3 days to train on 1000 16 core machines. They called this "inexpensive way to develop features from unlabeled data". Later they point out that their model was "more than an order of magnitude larger than other large networks reported in literature".