3 ms·
What do you mean by things getting interresting ? Did I miss something after 2005 ? Do you have some reference on the web ?
by chmike 13y ago
What do you mean by things getting interresting ? Did I miss something after 2005 ? Do you have some reference on the web ?
- dave_sullivan 13y ago2006 is commonly cited as the year when "deep learning" started becoming practical. Pretty sure it was Hinton's group, but they used greedy unsupervised pre-training to get a good initialization of the weights, then followed by supervised finetuning of said weights. That result kicked off a lot of renewed interest in NNs, which then led to using GPUs for a 40x speedup, which then led to many more impressive results (and they just keep coming). It turns out the unsupervised pre-training isn't even necessary, go figure...
- chmike 13y agoThank you: http://en.wikipedia.org/wiki/Deep_learning http://en.wikipedia.org/wiki/Deep_learning