4 ms·
In practise, how do you know if SDG has converged to a global optimum, and do you let it run long enough in practise until covergence?
by GregarianChild 6y ago
In practise, how do you know if SDG has converged to a global optimum, and do you let it run long enough in practise until covergence?
- unishark 6y agoYou don't know. The point was even if you did get there it could still be an overfit model you don't want, since it's based on a training data set, not the true statistics of the distribution the samples come from.