3 ms·
Maybe 67% is too much, but the GPUs are the most expensive thing in all those datacentres. Anyway, according to the latest articles[0], 1000B is the lower boun
by vb-8448 1mo ago
Maybe 67% is too much, but the GPUs are the most expensive thing in all those datacentres.
Anyway, according to the latest articles[0], 1000B is the lower bound.
[0] https://sg.finance.yahoo.com/news/ai-infrastructure-investment-exceed-1-120000797.html https://sg.finance.yahoo.com/news/ai-infrastructure-investme...
- kennywinker 1mo agoThe most expensive thing in my house isn't even 1% of the value of my house and everything in it.
- vb-8448 1mo agoImagine a house full of racks of gpus!
- vb-8448 1mo agoImagine a house full of racks of gpus!
- kennywinker 1mo agoI can imagine that. I could probably fit more GPUs in my closet than the cost of my house. Now imagine adding a complex liquid cooling system to my house, upgrading the wiring to support the extra power draw, and some full time staff to maintain the space and keep the GPUs running. Wouldn't be hard to switch the balance back away from GPUs toward the infrastructure around them. And let's also imagine I include my massive GPU usage bill in the house column. And while we're at it let's also include my full time staff of researchers in the house column.
- vb-8448 1mo agoNo way staff, complex liquid cooling and everything else is going to cost more than the hardware itself. All articles that I found on "ai datacenters cost breakdown" say that >60% is for the HW inside.
- kennywinker 1mo agoWell then we're left with the assumption that 100% of the new data center buildout will be done with Nvidia GPUs, with absolutely ZERO being AMD GPUs or google TPUs.