3 ms·
For one thing you can use the H100 to heat a room - it uses more than 10x the power of an M2 Ultra.
by mr_toad 3y ago
For one thing you can use the H100 to heat a room - it uses more than 10x the power of an M2 Ultra.
- winwang 3y agoConsider AMD Epyc 7742 vs an A100 -- 225W vs 400W (according to some TDP numbers). That's 1.8x-2.0x increase in energy, but something like 10x-100x more integer operations per second (depending on size of integers, depending on if you count the tensor cores or not).