Backprop is fun. You may also enjoy a look at the generalization: reverse accumulation http://www.win-vector.com/blog/2010/07/gradients-via-reverse-accumulatio

Backprop is fun. You may also enjoy a look at the generalization: reverse accumulation http://www.win-vector.com/blog/2010/07/gradients-via-reverse-accumulation/ http://www.win-vector.com/blog/2010/07/gradients-via-reverse... .