2 ms·
Am I reading this right? A 55x improvement while also going from an M2 Air to an RTX 4090? If so this doesn’t seem like a logical comparison and the 55x claim
by threesevenths 3y ago
Am I reading this right? A 55x improvement while also going from an M2 Air to an RTX 4090?
If so this doesn’t seem like a logical comparison and the 55x claim would likely not translate when using the same hardware.
- kuprel 3y agoThe M2 Air was actually much faster than whatever CPU was on the cloud RTX4090 machine I rented. I chose the stronger benchmark to compare to
- kuprel 3y agoUsing int16 and an H100 the speedup is actually 108x over the M2 air
- lostmsu 3y agoWhy is it surprising? CPU-only M2 probably has under 1 teraops while RTX 4090 has 77. M2's GPU was not used, but even it only provides around 4 teraops, so would have been ~20x slower than 4090.