Another interesting point--that chain-rule gradient evaluation is essentially something called automatic differentiation: https://en.wikipedia.org/wiki/Automat

Another interesting point--that chain-rule gradient evaluation is essentially something called automatic differentiation: https://en.wikipedia.org/wiki/Automatic_differentiation https://en.wikipedia.org/wiki/Automatic_differentiation which is really cool stuff and should be included more often when talking about backprop.