I recently read another great post by the same author about the connection between optimisation with constraints and backpropagation algorithm https://archives.

I recently read another great post by the same author about the connection between optimisation with constraints and backpropagation algorithm https://archives.argmin.net/2016/05/18/mates-of-costate/ https://archives.argmin.net/2016/05/18/mates-of-costate/ Apparently based on older LeCun's paper.