4 ms·
There is not enough water or power to support the current AI stock prices.
by grajaganDev 2y ago
There is not enough water or power to support the current AI stock prices.
- crimsoneer 2y agoIt's worth recognising that a year ago gpt-4 was the cutting edge, and today you can now run a gpt-4 class model on a macbook pro (with lots of ram, sure).
- EVa5I7bHFq9mnYK 2y agoA year ago gpt-4 was the cutting edge, the new cutting edge model takes 11.2 MWh of energy to answer a single question (enough to power a home for 4 years).
- PittleyDunkin 2y agoYea but gpt-4 is also only very slightly marginally useful in terms of productivity as it stands today. I highly doubt we're going to get returns on this without huge structural changes to how chatbots work.
- crimsoneer 2y agoSure, I think that's fair - the tech is only one part of the whole equation. Just pointing out that power demands are really quite a small (and actually quite surmountable) part of the problem.
- gopher_space 2y agoIt's interesting to look at how hardware requirements change alongside acceptable response time. Knowing when you need a reply seems like it might save a lot of money.
- agilob 2y agoThe executive order talks about building new geothermal power plants to support AI infra
- PittleyDunkin 2y agoHow about we cut the AI bit and just get a nice C02 decrease, i.e. the actual thing that will support future humans? THat's one more coal plant we can shut down.
- grajaganDev 2y agoWhat about the water?