Although it's right that most GEMMs are for large-ish, sqare-ish matrices, small and skinny ones are actually important and targeted for some HPC applications.

Although it's right that most GEMMs are for large-ish, sqare-ish matrices, small and skinny ones are actually important and targeted for some HPC applications. The relevant comparison would be with libxsmm [1], which also targets deep learning (on x86_64), though I don't think the released version does reduced precision. 1. https://libxsmm.readthedocs.io/ https://libxsmm.readthedocs.io/