Thank you for sharing, this was a great article! I had to implement autodiff from scratch for Nx (https://github.com/elixir-nx/nx https://github.com/elixir-nx/

Thank you for sharing, this was a great article! I had to implement autodiff from scratch for Nx (https://github.com/elixir-nx/nx https://github.com/elixir-nx/nx) about 18 months ago and this would have helped me so much! I spent roughly a month chasing a bug because I was not handling the case of duplicated incoming nodes and you outline it very clearly. I will be recommending the article from now on to anyone who needs to understand how autodiff works.