2 ms·
my understanding is that the issue is that the full Hessian of the loss is too expensive to compute at each step for the relative size of the increase in learni
by make3 9y ago
my understanding is that the issue is that the full Hessian of the loss is too expensive to compute at each step for the relative size of the increase in learning speed
- _0ffh 9y agoYeah I think that's why quasi-Newton methods like BFGS have been developed.