3 ms·
The 1.5 here is for a single core, though. So if we assume that the performance core on an M1 is around 7.5 watts (I’m not actually sure, seems like a reasonabl
by bee_rider 4y ago
The 1.5 here is for a single core, though. So if we assume that the performance core on an M1 is around 7.5 watts (I’m not actually sure, seems like a reasonable upper bound though if a whole M1 mini is around 39 watts), we’d be looking at around 750 watts to match. Which seems like a surprisingly non-crazy amount of power given these are 32 bit flops, unlike the 16 in the RTX 3090, and they come from a CPU.
- lostmsu 4y agoThis code runs on AMX co-processor. From the article: > An important distinction is that the AMX:CPU ratio is not 1:1; not every core has its own AMX co-processor. My understanding is there's only 1 of those per regular M1 CPU, maybe 4 on the largest one (Ultra).
- brigade 4y agoI tried gemm-benchmark on my M1 Max, and it took 22W to hit 2.2 Tflops with AMX (accelerate) or 36W to hit 270 GFlops with NEON (OpenBLAS) So that's actually just about as power-efficient for fp32 as a 3090, which according to wikipedia is 35 Tflops in 350W. Supposedly AMX can do 2x rate for fp16 as opposed to the 3090's 4x rate, so maybe 2x less efficient than a 3090 for fp16. Interestingly, fp64 hits 370 Gflops at 15W...