4 ms·
Vide for PyTorch: https://rockt.github.io/2018/04/30/einsum https://rockt.github.io/2018/04/30/einsum ("Einsum is All you Need - Einstein Summation in Deep Lear
by stared 8y ago
Vide for PyTorch: https://rockt.github.io/2018/04/30/einsum https://rockt.github.io/2018/04/30/einsum ("Einsum is All you Need - Einstein Summation in Deep Learning" by Tim Rocktäschel).
The same convention as in NumPy, but IMHO much nicer visual explanation for beginners. Also, think about tensor diagrams, as in the Feynman diagram in "Simple diagrams of convolutional neural networks" https://medium.com/inbrowserai/simple-diagrams-of-convoluted-neural-networks-39c097d2925b https://medium.com/inbrowserai/simple-diagrams-of-convoluted....
- p1esk 8y agoNice! I remember trying to implement Hinton's capsules layer in tensorflow [1], and stumbling upon Einstein notation syntax. Took me a while to figure it out. [1] https://github.com/michaelklachko/CapsNet/blob/master/capsnet_cifar.py#L68 https://github.com/michaelklachko/CapsNet/blob/master/capsne...