2 ms·
If you interpret "calculation per second" as a FLOPS [as measured on LINPACK], 20 quadrillion is 20 PFLOPS. 20 PFLOPS puts you at #7 on TOP500. A looser interp
by jcranmer 8y ago
If you interpret "calculation per second" as a FLOPS [as measured on LINPACK], 20 quadrillion is 20 PFLOPS. 20 PFLOPS puts you at #7 on TOP500.
A looser interpretation is that you could count the number of integer adds you can push through a second multiplied by vector width. The CPU component of this would be in the region of 1.5 GHz (AVX-512 clock-speed) * 64 (8-bit adds/512-bit vector) * 2 issue ports * 10-20 cores (I don't know where the $4,000 in 1999 dollars hits in terms of pricepoint here [1]). You're looking at the region of low single-digit TOPS here. I don't know enough about the physical architecture of GPUs to estimate their theoretical headcount here, but I'd be surprised if you could push much past the teens of TOPS on those machines either.
So, for the price point he predicted, we're off by a factor of 1,000.
[1] I'm counting physical cores here. Hyperthreads don't add more actual ALUs, they just let two independent threads fill these up with operations.