3 ms·
How is SVM doing comparing to the Neural Network renaissance with deep learning?
by wslh 13y ago
How is SVM doing comparing to the Neural Network renaissance with deep learning?
- mjn 13y agoIt's always hard to get a birds'-eye view of these things, but from my vantage point, I think SVMs are much more widely used in applications, but have been surpassed by deep learning as the current hot research area in machine learning. There is still SVM research, but it's plateaued compared to the frenzy of the late 1990s and early 2000s, while deep learning has taken off in the past few years. SVM has instead entered the realm of "standard ML tool", as an off-the-shelf technique with robust and well-documented implementations that can be applied in a reasonably straightforward way.
- joe_the_user 13y agoOne interesting thing is that the mechanism of SVMs is formally identical to that of either deep or shallow neural network. The main thing that different is the learning mechanism. I believe Neural Networks inherently take more time to learn than SVMs but for all I know networks could learn a set "better". I believe NNs and SVMs involve tweaks and judgement to perfect
- bun-neh 13y agoThere was a paper not too far back that used SVMs in deep learning and leaped over the then state-of-the-art performance. http://arxiv.org/abs/1306.0239 http://arxiv.org/abs/1306.0239