3 ms·
LLMs will radically accelerate power consumption growth, given the extreme processing power they require compared to traditional apps. It'll probably go to 10%
by anonylizard 3y ago
LLMs will radically accelerate power consumption growth, given the extreme processing power they require compared to traditional apps.
It'll probably go to 10% in 2 decades if unchecked. The IEA analysis is completely outdated because it was made pre ChatGPT (As evidenced by the many references to crypto, which is no longer relevant).
Granted, its very easy to boost power efficiency in data centers, given the high margins and low pollution, so the industry is putting huge efforts into restraining power consumption in data centers.