4 ms·

Also check out this project, it is going to be presented at ICML2012 in a couple of weeks: http://research.google.com/archive/unsupervised_icml2012.html http:/

by ot 14y ago

Also check out this project, it is going to be presented at ICML2012 in a couple of weeks: http://research.google.com/archive/unsupervised_icml2012.html http://research.google.com/archive/unsupervised_icml2012.htm... they trained a huge neural network with millions of unlabeled frames from Youtube, and derived high-level features. The authors showed that the network learned without supervision the concepts of human face, human body... and cat.

abeppu 14y ago
That work was impressive -- but kind of over the top. From what I can tell, their dataset could at most have been like 2.5TB uncompressed. Their model took 3 days to train on 1000 16 core machines. They called this "inexpensive way to develop features from unlabeled data". Later they point out that their model was "more than an order of magnitude larger than other large networks reported in literature".