3 ms·
TL;DR: a few new heuristics to tweak the step size of gradient descent. The more I read about this kind of machine learning research, the more I'm getting conv
by tzahola 9y ago
TL;DR: a few new heuristics to tweak the step size of gradient descent.
The more I read about this kind of machine learning research, the more I'm getting convinced that we're very-very far from the Kurzweilian singularity...
- Houshalter 9y agoThe AI effect is real. The second you understand something, it stops being magical.
- amelius 9y agoBut what can we expect? We still have trouble solving a large general system of linear equations, even after decades of research. And now we're trying to optimize large nonlinear systems ...
- Houshalter 9y agoFinding the global optimum is a lot harder than just finding a good local optima quickly. Which is good enough for ML.