4 ms·
A Trick for Backpropagation of Linear Transformations
- greatgib 1y agoNice and easy article for a normally complicated topic.
- hansvm 1y agoThat's quite a neat trick. You do need to be careful if the same matrix appears more than once in your einsum call though.
- brandonb 1y agoVery nicely explained. Your article on rendering fractals was also well-done!
- tripplyons 1y agoThank you!
- fzimmermann89 1y ago..and for complex valued tensors, you need to conjugate.
- tripplyons 1y agoI've only accounted for real numbers. I'm not sure how to cleanly account for conjugates when some of the einsums would need them and others wouldn't. For example, a matrix product would need a complex conjugate, but a Hadamard product wouldn't. If there is an elegant way to extend this to complex numbers, let me know!