4 ms·
I can’t wait for how cheap compute will be during the inevitable AI winter.
by andy_ppp 1y ago
I can’t wait for how cheap compute will be during the inevitable AI winter.
- blibble 1y agounfortunately mostly useless 4 bit floating point
- nicce 1y agoHow is it useless?
- cyber_kinetist 1y agoIf you try to do any sort of scientific calculation (ex. physical simulation), at least 32-bit floats are needed to ensure adequate numerical precision. Ideally 64-bit floats are the best, but FP64 performance in recent GPUs are bad up to the point that you can say they're not supported anymore...
- cuttothechase 1y agoWill it work out the second time around? As long as these data centers and their cloud patrons still keep providing those compute options, unlike, the 2000 crash where commodity hardware was widely available and the business use case was comparatively decentralized.
- kingstnap 1y agoIt's all but inevitable that compute gets cheaper. AI winter -> Datacenters have too much compute to sell -> Compute gets cheaper AI summer -> Hardware companies are incentivized to make better chips-> Compute gets cheaper The second actually is more powerful in the long run. The AI boom has actually made compute very cheap per flop.