2 ms·
It fully depends on the workload. The 4090 itself draws around 450w at load, and the M2 Ultra peaks around 300w. If your workload is >1.5x faster on Nvidia hard
by smoldesu 3y ago
It fully depends on the workload. The 4090 itself draws around 450w at load, and the M2 Ultra peaks around 300w. If your workload is >1.5x faster on Nvidia hardware, then it's per-prompt efficiency probably beats out the M2 Ultra.
- frontierkodiak 3y agoNot to mention that you can trivially set a 300w power cap on the 4090 and still get 75-80% of peak FLOPS.
- datameta 3y agoAll valid points, I think I looked at it too trivially and fired an opinion from the hip.