4 ms·
It also assumes no progress in power efficiency during inference. If the price of OpenAIs mini models are indicative of compute, and therefore, energy usage, I
by dghlsakjg 2y ago
It also assumes no progress in power efficiency during inference.
If the price of OpenAIs mini models are indicative of compute, and therefore, energy usage, I would be surprised if we didn’t see a lot of similar energy optimized models in the future.
- Teever 2y agoYeah but Jevons paradox. Computing as a whole has become a lot more efficient compared to say 30 years ago but globally certainly use a lot more compute to make up for that increase in efficiency.
- appplication 2y agoYeah I don’t believe for a second that we’re going to ever see a net decrease in AI energy use during our lifetimes at this point. Besides, the point of discussing this isn’t that AI isn’t efficient enough, it’s that there is a clear path to it consuming absolutely massive amounts of energy, and that will continue to scale at an increasing rate indefinitely. This is a reality we need to expect and plan for. Substantial investments must be made - today - in renewable energy production and storage to meet new demand.