3 ms·
Gradient descent also allows batching, which reduces the memory requirements, can the other methods support that?
by quickthrower2 3y ago
Gradient descent also allows batching, which reduces the memory requirements, can the other methods support that?
- nerdponx 3y agoAs far as I know, this is the #1 gradient descent superpower that makes it the preferred choice above all others. I don't think e.g. L-BFGS supports batching, I've certainly never seen it.