3 ms·
It's not the execution of FMAs that's the challenge, it's the ramp up / down. And I assure you GPUs do have challenges with that as well. That's just less well
by atq2119 2y ago
It's not the execution of FMAs that's the challenge, it's the ramp up / down.
And I assure you GPUs do have challenges with that as well. That's just less well known because (1) in GPUs, all workloads are vector workloads, and so there was never a stark contrast between scalar and vector regimes like in Intel's AVX-512 implementation and (2) GPU performance characteristics are in general less broadly known.
- menaerus 2y agoYes, I agree that it was premature to say that GPUs aren't suffering from the same symptoms. There's just not enough evidence but the differences in the compute power are still large.
- TinkersW 2y agoIf you normalize for cost, the difference isn't nearly as large as you might think, around 4-5x.