4 ms·
A Step by Step Backpropagation Example
- jmount 11y agoBackprop is fun. You may also enjoy a look at the generalization: reverse accumulation http://www.win-vector.com/blog/2010/07/gradients-via-reverse-accumulation/ http://www.win-vector.com/blog/2010/07/gradients-via-reverse... .
- discardorama 11y agoEvery such example stops at vanilla backprop. What I'd like to see (and which I think would be a lot more challenging) is: BPTT for a recurrent network. BP for an LSTM or GRU. Can someone do that?