3 ms·
> In the 1960s, academics including... arrived at the theory of backpropagation. It was clearly phrased this way specifically because backprop is just the chai
by 6gvONxR4sf7o 6y ago
> In the 1960s, academics including... arrived at the theory of backpropagation.
It was clearly phrased this way specifically because backprop is just the chain rule applied in a particular direction, and as such has been invented and reinvented over and over by every one under the sun. Hell, a lazy googling says gradient descent goes back to Cauchy.