4 ms·
That's also a CPU that came out four years later than the A100. The contemporaneous B200 is not optimized for FP32 and does 74.45 TFLOP/s. For FP16 it's at ~2 P
by aesthesia 5mo ago
That's also a CPU that came out four years later than the A100. The contemporaneous B200 is not optimized for FP32 and does 74.45 TFLOP/s. For FP16 it's at ~2 PFLOP/s.
- p1esk 5mo agoThe point is that modern CPUs are not as slow as most DL people think. Roughly 10x slower but with a lot more memory.