4 ms·
Nice description of backprop for sure. Aren't people using conjugate gradient descent to optimize NN weights now? Sure you need the partial derivatives but ...
by plg 13y ago
Nice description of backprop for sure.
Aren't people using conjugate gradient descent to optimize NN weights now? Sure you need the partial derivatives but ... that's what GPUs are for, right? :)
- nimish 13y agoBackprop lets you calculate the gradient efficiently. What you do with that gradient is up to you (I would try L-BFGS or something akin to a stochastic variation). So you could use conjugate gradient or some other optimization method