4 ms·
Even if you think this particular team cheated, the idea that nobody will find ways of making training more efficient seems silly - these huge datacenter invest
by bad_haircut72 2y ago
Even if you think this particular team cheated, the idea that nobody will find ways of making training more efficient seems silly - these huge datacenter investments for purely AI will IMHO seem very short sighted in 10 years
- neverthe_less 2y agoIsn't it possible with more efficiency, we still want them for advanced AI capabilities we could unlock in the future?
- thfuran 2y agoOperating costs are usually a pretty significant factor in total costs for a data center. Unless power efficiency stops improving much and/or demand so far outstrips supply that they can't be replaced, a bunch of 10 year old GPUs probably aren't going to be worth running regardless.
- foobiekr 2y agoMore like three years. Even in the best case the retained value curve of GPUs is absolutely terrible. Most of these huge investments in GPUs are going to be massive losses.
- newAccount2025 2y agoDo we have any idea how long a cloud provider needs to rent them out for to make back their investment? I’d be surprised if it was more than a year, but that is just a wild guess.
- tobias3 2y agoSeems bad for those GPU backed loans
- nejsjsjsbsb 2y agoOh wow. Time for some AAA rated GPU loans!
- kandesbunzler 2y ago>retained value curve of GPUs is absolutely terrible source?
- int_19h 2y agoI actually wonder if this is true in the long term regardless of any AI uses. I mean, GPUs are general-purpose parallel compute, and there are so many things you can throw at them that can be of interest, whether economic or otherwise. For example, you can use them to model nuclear reactions...
- nejsjsjsbsb 2y agoGPUs can do other stuff though. I wouldn't bet on GPU ghost towns.
- dsign 2y ago>> for purely AI There is a big balloon full of AI hype going up right now, and regrettably it may need those data-centers. But I'm hoping that if the worst (the best) comes to happen, we will find worthy things to do with all of that depreciated compute. Drug discovery comes to mind.
- fragmede 2y agoThe "pure AI" data center investment is generically a GPU supercomputer cluster that can be used for any supercomputing needs. If AI didn't exist, the flops can be used for any other high performance computing purpose. weather prediction models perhaps?
- energy123 2y agoBut we're in the test time compute paradigm now, and we've only just gotten started in terms of applications. I really don't have high confidence that there's going to be a glut of compute.