On the topic of matrix multiplication there is an excellent interactive 3D visual explainer from the PyTorch team blog on how it applies to attention heads and

On the topic of matrix multiplication there is an excellent interactive 3D visual explainer from the PyTorch team blog on how it applies to attention heads and weights for ML. https://pytorch.org/blog/inside-the-matrix/ https://pytorch.org/blog/inside-the-matrix/