Also worth observing BLAS is an even weirder case as odds are the CPU architecture designed to ensure they could hit a high % of peak FMA throughput for that ke

Also worth observing BLAS is an even weirder case as odds are the CPU architecture designed to ensure they could hit a high % of peak FMA throughput for that kernel, so there's a lot of SW/HW co-design going on there too.