3 ms·
Doesn’t gradient descent use a convex cost function so that it always generates a global minimum?
by kaczordon 6y ago
Doesn’t gradient descent use a convex cost function so that it always generates a global minimum?
- wxnx 6y agoNo, not necessarily. The objective functions used to train neural networks are generally non-convex (the nets themselves being non-convex as well), but are traditionally trained using stochastic gradient descent (and its variants).
- mrtranscendence 6y agoThis really threw me off when I first started learning about ANNs, coming from a traditional econometrics background. B-but ... the parameters aren’t identified!