2 ms·
Great references (though I can't open [4]). I sometimes think the contributions of numerical analysis pioneers is undervalued (eg Wilkinson, Kahan, Golub). Bac
by FabHK 8y ago
Great references (though I can't open [4]).
I sometimes think the contributions of numerical analysis pioneers is undervalued (eg Wilkinson, Kahan, Golub). Backpropagation is really just reverse mode AD, and has been discovered many times, as you point out.
https://en.wikipedia.org/wiki/Automatic_differentiation https://en.wikipedia.org/wiki/Automatic_differentiation
EDIT: [4] works now.