4 ms·
If you don’t use AI for climate reasons then you should read the recent reports about how little electricity and water is actually used. It’s basically zero (im
by steinvakt2 1y ago
If you don’t use AI for climate reasons then you should read the recent reports about how little electricity and water is actually used. It’s basically zero (image and video models excluded). Your information about this is probably related to GPT3.5 or something. Which is now 3 years old - a lifetime in AI world.
- wat10000 1y agoDon't newer models use more energy? I thought they were getting bigger and more computationally intensive.
- trenchpilgrim 1y agoThey use a massive amount of energy during training. During inference they use a tiny amount of energy, less than a web search (turns out you can be really efficient if you don't mind giving wrong answers at random, and can therefore skip expensive database queries!)
- wat10000 1y agoRight, but the comment I was responding to suggested that ChatGPT3.5 used lots of energy and newer models use less.
- trenchpilgrim 1y agoIndeed, this is correct. See today's Claude Haiku 4 announcement for an example.
- wat10000 1y agoLooking at https://platform.openai.com/docs/pricing https://platform.openai.com/docs/pricing, GPT 3.5 is $1.50-4 per million output tokens, and GPT 5 is $0.40-120, with plain "gpt-5" with no qualifiers going for $10/million. GPT5 is probably cheaper in the sense that gpt5-nano is at least as capable as 3.5 while costing less, but the "normal" models are more expensive for the newer ones, and thats what people are generally going to be using.
- greekrich92 1y agoBig data centers running tons of GPUs and the construction of even bigger ones is not carbon neutral come on