3 ms·

Honest question. I remeber some recent news about Microsoft considering to bring back in use an "old" nuclear power plant to cover their (maybe projected?) clou

• Ukv 2y ago
  An individual user's model usage is negligible, in that you should not feel bad about querying an LLM unless you feel approximately 1000 times worse about drinking a cup of coffee. But Google/Microsoft provide services for hundreds of millions, or even billions, of users. In the same way, if your service was hairdryers (owing to progress in hot-air-over-IP) and you had 300 million users, you'd need 300 million * 2000W * 10 minutes = 100000MWh daily, or about 5 copies of the nuclear power plant the Microsoft are opening. You could look at it as those hairdryer power plants already effectively existing, just distributed as a small portion of many plants.
  • GTP 2y ago
    Yes, I get that it is an issue of scale, but that's the issue in the end. A commenter rightfully pointed out that there's no point in giving examples of other things that consume the same or more if at the end of the day we don't take action on those anyway. Another commenter, equally rightly, answered that the utility of these things are subjective, and this changes what we feel we should take action on. I still have to find a clear position on this.