7 ms·
The words "deep learning" don't refer to a way of training neural nets. It's a marketing term for neural nets that have "a lot" of layers. Neural nets have bee
by shpx 10y ago
The words "deep learning" don't refer to a way of training neural nets.
It's a marketing term for neural nets that have "a lot" of layers. Neural nets have been around for over 30 years, calling them deep learning was a smart re-branding move.
- mcv 10y agoFrom what little I've read, deep learning is a new way of training nets. Deep neural nets have also been around for 30 years, but backpropagation, their traditional learning algorithm, isn't as efficient in training the middle layers.
- p1esk 10y agoYou should keep reading. Backprop is still the best, and pretty much the only way to train neural nets (deep or not). Other ways exist (e.g. weight perturbation), but no one uses them. EDIT: I have to clarify: backprop is just one half of the training algorithm, you also gradient descent, and there are many variants of it.
- mcv 10y agoMan, I've been out of Neural Nets a long time. I studied them back in the early 1990s. Perceptrons and backpropagation. Didn't really keep up with the state of the art, I'm afraid. Maybe I should catch up.