3 ms·
"on Convex functions" Ah thanks, I thought I missed something. That makes total sense. "SA/RR are global optimization methods" RR is definitely global, but (
by alfiedotwtf 10y ago
"on Convex functions"
Ah thanks, I thought I missed something. That makes total sense.
"SA/RR are global optimization methods"
RR is definitely global, but (depending on your cooling function I guess) I would say SA is not.
- akssri 10y agoIt should be noted that things like momentum etc in DNN training are inspired directly from Nesterov, and apparently work very well.