4 ms·
After watching 'Recent Developments in Deep Learning' by Geoff Hinton [1] a while ago I did come away believing that there does seem to be quite a bit of untapp
by mtrimpe 12y ago
After watching 'Recent Developments in Deep Learning' by Geoff Hinton [1] a while ago I did come away believing that there does seem to be quite a bit of untapped potential in deep neural nets.
Do you feel that talk is overly optimistic/misleading? Or just that you don't think there's that much money to be made with it?
[1] https://www.youtube.com/watch?v=vShMxxqtDDs https://www.youtube.com/watch?v=vShMxxqtDDs
- motters 12y agoI've also seen that talk. In many cases I think the advantages which may be had from deep learning are likely to be marginal - a few percent improvement over the next best algorithm. Multi-layer neural nets already existed for a couple of decades, and deep learning is really just a refinement on that, making the training process faster and more robust to overfitting.
- bluishgreen 12y agoDo you know of any other system that gets ~14% error rate on the IMAGENET dataset? The next best system as recent as 2012 was doing ~26% error. That is a pretty big gap, especially considering IMAGENET is a million image data set. (btw did not see the talk)
- visarga 12y ago> especially considering IMAGENET is a million image data set ... and that human error rate is also > 0. Sometimes machine learning bests the humans.