3 ms·
It's going to absolutely blow this away. Here are some of my single precision GEMM benchmarks for the M1 and M1 Pro: https://github.com/danieldk/gemm-benchmark
by microtonal 5y ago
It's going to absolutely blow this away. Here are some of my single precision GEMM benchmarks for the M1 and M1 Pro:
https://github.com/danieldk/gemm-benchmark#1-to-16-threads https://github.com/danieldk/gemm-benchmark#1-to-16-threads
tl;dr, the M1 can do ~1300 GFLOP/s and the M1 Pro up to ~2700GFLOP/s.
On the vanilla M1, that's 28 times faster than the best result in the post.
The difference (besides years of optimizing linear algebra libraries) is that Accelerate uses the AMX matrix multiplication co-processors through Apple's proprietary instructions.