Whilst it's absolutely not required knowledge for most deep learning, if you are interested in more fully understanding the chain rule, my friend Terence Parr (

Whilst it's absolutely not required knowledge for most deep learning, if you are interested in more fully understanding the chain rule, my friend Terence Parr (the ANTLR guy) and I wrote a fairly thorough tutorial for matrix calculus https://explained.ai/matrix-calculus/index.html https://explained.ai/matrix-calculus/index.html .