4 ms·
And if you can't make sure all of them are divisible by 2 often, at least pick the inner dimensions of your matmuls (if possible).
by carlmr 2y ago
And if you can't make sure all of them are divisible by 2 often, at least pick the inner dimensions of your matmuls (if possible).