4 ms·
I think that's expected. SGD in such a high-dimensional space is exceedingly likely to find such a minimum.
by sp332 2y ago
I think that's expected. SGD in such a high-dimensional space is exceedingly likely to find such a minimum.
- benreesman 2y agoI’m aware of both theoretical and empirical arguments that I find quite persuasive that you’re exactly right. I think it’s extremely thought provoking why they would be symmetrically, locally Euclidean in such abundance.