2 ms·
The CO2 concerns of using LLMs are massively overblown these days (with the exception of o1-pro and GPT-4.5 at least). The energy efficiency of most models has
by simonw 2y ago
The CO2 concerns of using LLMs are massively overblown these days (with the exception of o1-pro and GPT-4.5 at least).
The energy efficiency of most models has improved by an order of magnitude since the most widely cited CO2 usage papers were published.
(It remains frustratingly difficult to get accurate numbers though: at this point I think more transparency would help rather than hurt the big AI labs)
- cube2222 2y agoA good recent in-depth article about this: https://andymasley.substack.com/p/individual-ai-use-is-not-bad-for https://andymasley.substack.com/p/individual-ai-use-is-not-b...
- hansmayer 2y agoI meant that as a side note, but even if we put the CO2 issue completely aside, I am still failing to see what is this "feature" bringing, and judging by the lame example they picked, the Anthropic are not quite sure either.