6 ms·
AI needs so much power that old coal plants are sticking around
- deleted 3y ago[deleted]
- whatshisface 3y agoTraining AIs would be a great way to soak up daytime solar excess.
- lm28469 3y agoSince computers are basically electrical resistances you might as well heat houses with them, put the data centers somewhere cold, next to a nuclear power plant, water cool them and heat a few neighbourhoods
- jijijijij 3y agoYou could, you know, use the heat of the nuclear power plant directly instead.
- lm28469 3y agoThen you lose the part where you get free computational power
- alberto180 3y agoYou know what these huge towers with white smoke at nuclear plants do?
- deleted 3y ago[deleted]
- lm28469 3y agoYes they waste heat by releasing it in the atmosphere as water vapor. They neither power computers nor heats home
- deleted 3y ago[deleted]
- kalleboo 3y agoNuclear plants only have about a 15 degree C temperature gradient in their cooling water in winter, the waste heat is not very useful. Swedish power companies have extensively researched using their nuke plants for district heating since they were planning the plants originally in the 60's, but it's never penciled out. Meanwhile you can run a CPU up to 95 C.
- jijijijij 3y agoWho is talking about waste heat? If you want to heat homes you could just use the thermal energy produced directly at a much higher efficiency. You don't need the detour of electricity generation at all. See, my point isn't really that you should do that, but the fallacy in thinking there is a "free" energy hack for crypto, AI, ... . Wasting electrical energy is always bad.
- kalleboo 3y agoThis is something that's actually done in Scandinavia https://www.datacenterdynamics.com/en/news/facebook-begins-installing-district-heating-system-odense-data-center-denmark/ https://www.datacenterdynamics.com/en/news/facebook-begins-i...
- hooo 3y agoBut given the cost of the hardware, it doesn't make sense to idle them overnight. Owners of the hardware will want to utilize them as close to 100% as possible.
- whatshisface 3y agoDatacenters upgrade their computers when the price of electricity outweighs the price of buying more efficient devices. Ergo, used datacenter hardware is separated from economic reuse by the price of electricity. That is what you would build the solar energy dumps out of.
- Razengan 3y agoBiological AI was around for millions of years before coal plants.
- chrisco255 3y agoOf course, coal is derived from biological material from hundreds of millions of years ago.
- dylan604 3y agoso, AI is an ouroboros?
- drjasonharrison 3y agowell, lol, but coal came from plants that didn't decay and were buried. So intelligence wasn't involved in making the coal.
- ElevenLathe 3y ago...as far as we know!
- deleted 3y ago[deleted]
- niklasbuschmann 3y agohttps://archive.is/spRaU https://archive.is/spRaU
- alphazard 3y agoThe article makes it seem like this is only from training runs or inference; It's not. Compute demand is always growing, and the latest reason for it to grow is the mini-boom ML has created. A lot of that is stuff other than the training or inference, like web servers, databases, etc. this boom has created many new companies, each with their own infrastructure needs.
- drjasonharrison 3y agoThe article also doesn't present any quantitative data about how much money is going to data centers vs factories (batteries for electric car) or other "economic driven development". Some service areas they include could easily include private home shifts from gas/oil to electrical heat pumps, air conditioning adoption, etc. They do cite China and India needing more electricity to produce solar panels and rechargeable batteries.
- mbostleman 3y agoAI is just another improvement in a long of human progress and they have all required more energy.
- forgetfreeman 3y agoThat it is an improvement remains to be seen.
- AlexandrB 3y agoThat's just not true. A lot of human progress has been about reducing energy inputs for doing the same thing. The simplest example is the steady increase in fuel efficiency since the 1950s.
- kibwen 3y agoThere are two kinds of progress: 1. Real progress, which involves doing more with the same amount of energy; in other words, an improvement in efficiency. 2. Fake progress, which involves doing more by bringing more energy to bear. Both feel like progress because you're "doing more", but only the first is valuable in the long-term. And so much of the technological progress of the past century has been fake progress that people fail to realize the distinction.
- hnaccountme 3y agoAgreed, Most of AI is just investors spending money so they can sell their stock to someone else for a profit. Same this happened with blockchain. It will happen again with this AI boom. People just want to make a quick buck. Read value generation is hard
- jes5199 3y agowe’re crossing a tipping point where new solar is cheaper than existing coal in many places. So this is a short-term problem
- toomuchtodo 3y agoRenewable PPAs for AI compute would help bridge the gap.
- nwiswell 3y agoBut AI hardware is much, much more expensive than either of them. Clearly it's not acceptable to simply shut AI training off at night, so solar is not a complete solution.
- AlexandrB 3y agoDoes anyone have data on the relative cost of running AI-enhanced experiences vs. traditional ones? For example, search: what's the increase in cost to Microsoft when you do a Copilot search vs. a plain Bing search? I have a vague hunch that it's a lot more expensive and is being subsidized by the companies in question as they try to grab market share, but I don't have anything to back up this intuition. My worry is that we're in a bubble where AI is being applied to cases where it's not actually cost-effective. This might distort the market by suppressing non-AI competitors and then lead to some pretty drastic monetization when the bills start to come due.
- bawolff 3y agoMy intuition is that traditional search probably takes a lot of energy too. Its too bad we don't have any actual numbers
- vmfunction 3y agoFrom my limited understanding of this AI field, that it cost over million $ to train the model, after that the the query against the model is fast and doesn't cost a lot money. So with this AI/LLM it is more about the upfront cost, and how well the model is train using that millions dollars, and according to some data expert seems to be an art and a science [1]. Some AI experts here please correct me if I'm wrong. 1: https://www.amorphousdata.com/blog/time-series-vs-regression https://www.amorphousdata.com/blog/time-series-vs-regression
- sureglymop 3y agoBut then isn't the model out of date very quickly? It would need to be constantly retrained with current information...
- Legend2440 3y agoYes, but for now you just accept that - ChatGPT had a knowledge cutoff in 2022 until relatively recently.
- 3y ago
- x86x87 3y agoBut does it need more power than the whole country of Argentina or not? Should we ban AI because of the ridiculous power consumption and the negligible return compares to the environmental damage caused?
- dwd 3y agoThe decels would have you believe that and link AI with climate change. While LLMs might produce negligable returns, what about AI advances in material science which could lead to breakthrough ideas in energy storage or more environmentally safe energy production?
- empath-nirvana 3y agoJust in terms of economics, the demand for energy is elastic and even if we built out enough renewable energy to completely replace our non-renewable sources at today's usage and prices, people would just use twice as much energy. It's not going to be a matter of just building cheap renewable energy, it's going to be a matter of _banning non-renewable energy_ or at least taxing it significantly. There's not a maximum amount of energy per person that people will put to use. If you create more energy sources, we're going to use all of it. It doesn't have to do with AI or Cryptocurrency or cars or farming, or name any other use case that anybody in the world thinks its wasteful or shouldn't be allowed to use energy. If you ban AI from using fossil fuels, they'll switch to using renewable energy and some other technology will switch to fossil fuels. The only solution to ending the use of fossil fuels is banning the use of fossil fuels entirely. Technology will never do it.
- dmm 3y ago> The only solution to ending the use of fossil fuels is banning the use of fossil fuels entirely. Technology will never do it. If electricity is more expensive in the US because we have banned (or heavily taxed) fossil fuels, wouldn't all the AI servers just go overseas? How could AI "imports" be taxed to account for this?
- melling 3y agoThe story is noise. Don’t waste your time. Coal is dying in the United States. Renewables have already passed it: https://www.eia.gov/todayinenergy/detail.php?id=55960 https://www.eia.gov/todayinenergy/detail.php?id=55960 And the Biden Administration is tightening soot regulations so more coal plants will soon close: https://apnews.com/article/epa-air-pollution-soot-biden-wildfires-d48a02362129ecda5be4d44dbd3442ed https://apnews.com/article/epa-air-pollution-soot-biden-wild... Of course, globally coal usage is still growing. That’s the problem we desperately need to solve. https://www.forbes.com/sites/rrapier/2023/09/04/global-coal-consumption-returns-to-record-levels/amp/ https://www.forbes.com/sites/rrapier/2023/09/04/global-coal-...
- lqcfcjx 3y agoFrom financial perspective, Sequoia had a very insightful statement: "For every $1 spent on a GPU, roughly $1 needs to be spent on energy costs to run the GPU in a data center. So if Nvidia sells $50B in run-rate GPU revenue by the end of the year (a conservative estimate based on analyst forecasts), that implies approximately $100B in data center expenditures. The end user of the GPU—for example, Starbucks, X, Tesla, Github Copilot or a new startup—needs to earn a margin too. Let’s assume they need to earn a 50% margin. This implies that for each year of current GPU CapEx, $200B of lifetime revenue would need to be generated by these GPUs to pay back the upfront capital investment." The power/environment cost is usually largely ignored and it can be as much as the hardware cost (this is insane!). And if this cost won't decrease over time, it'll add additional risks to all end consumer companies being profitable.
- rokkitmensch 3y agoHeterodox business plan: colo facilities on-prem at coal powerplants.