>Let's say the cost of compute is 1 cent per 100B flops (probably a lowball). I might be totally misunderstanding this, but from the source you posted elsewher

>Let's say the cost of compute is 1 cent per 100B flops (probably a lowball). I might be totally misunderstanding this, but from the source you posted elsewhere[1], GPU Sale Price per Flops is as a little bit higher than 1*10^-11 dollars per flop, or 10^11 flops per dollar, or 10^9 flops per cent. So 1GFlops per cent. But Flops are Floating point operations per second. So you aren't paying 1cent for 100B flops, you're paying 1 cent for a card capable of doing 100B floating point operations per second. So let's say the card lasts 3 years and runs at 100% utilization (I know, it doesn't we can multiply by some efficiency metric later), there's about 9.5*10^7 seconds in 3 years. So that dollar cost isn't for 100B flops, it's for 100B * 9.5 *10^7 ( *some efficiency number). So it's many orders of magnitude cheaper than you're saying. In reality, the cost of running these things isn't the cost of buying the GPUs, it's the cost of the power to run the GPUs, and that's a totally different calculation we can do. [1]: https://aiimpacts.org/2019-recent-trends-in-gpu-price-per-flops/#GPU_price_single-precision_FLOPS\ https://aiimpacts.org/2019-recent-trends-in-gpu-price-per-fl...*