3 ms·
Backpropagation (as in, the training method for NNs) is an instance of gradient descent. There are many other instances (e.g. any EM algorithm does gradient des
by majewsky 9y ago
Backpropagation (as in, the training method for NNs) is an instance of gradient descent. There are many other instances (e.g. any EM algorithm does gradient descent, as does minimum search on a simple real function), so using the more specific term is appropriate.