> "Think about it: how can a small number of specialized experts, who hand write and tune assembly code, possibly scale their work to all the different configur

> "Think about it: how can a small number of specialized experts, who hand write and tune assembly code, possibly scale their work to all the different configurations while also incorporating their work into all the AI frameworks?! It’s simply an impossible task." By committing it to a common library that a lot of people use? There are already multiple libraries with optimized matrix multiplication. This is also exaggerating the expertise required. I'm not going to claim it's trivial, but you can genuinely google "intel avx-512 matrix multiplication", and find both papers and Intel samples.