5 ms·
The costs are also largely being ignored at the moment. Both the obvious marginal costs (electricity, hardware for compute, dev time) and the hidden costs (floo
by AlexandrB 2y ago
The costs are also largely being ignored at the moment. Both the obvious marginal costs (electricity, hardware for compute, dev time) and the hidden costs (flood of spam and misinformation).
- Yoric 2y agoAlso, the environmental cost. It's hidden, but won't be forever.
- russiancapybara 2y agoWould be awesome to have nuclear power stations dedicated to powering these data centers for inferencing. I believe Amazon just purchased a nuclear power plant in Pennsylvania for this.
- Bluecobra 2y agoI was really surprised to read the other day that Dell isn't making money on AI servers. I played around with the server build tool on their website and was surprised to see that a H100 adds ~$50K to a server! How the heck are these companies spending $100K per server going to get back their ROI? Are all these costs going to get written off as R&D? This really seems like the dot-com days but worse somehow. https://www.cnbc.com/2024/05/31/dell-shares-fall-ai-servers-concerns.html https://www.cnbc.com/2024/05/31/dell-shares-fall-ai-servers-...