4 ms·

You could think of it as "as much power as is used by NYC and Chicago combined". Which is fucking insanely wasteful.

deleted 1y ago
[deleted]
onlyrealcuzzo 1y ago
I dunno. Google is pretty useful. It uses >15 TWh per year. Theoretically, AI could be more useful than that. Theoretically, in the future, it could be the same amount of useful (or much more) with substantially less power usage. It could be a short-term crunch to pull-forward (slightly) AI advancements. Additionally, I'm extremely skeptical they'll actually turn on this many chips using that much energy globally in a reasonable time-frame. Saying that you're going to make that kind of investment is one thing. Actually getting the power for it is easier said than done. VC "valuations" are already a joke. They're more like minimum valuations. If OpenAI is worth anywhere near it's current "valuations", Nvidia would be criminally negligent NOT to invest at a 90% discount (the marginal profit on their chips).
- deleted 1y ago
  [deleted]
- Capricorn2481 1y ago
  Does Google not include AI?
- dns_snek 1y ago
  According to Google's latest environmental report[1] that number was 30 TWh per year in 2024, but as far as I can tell that's their total consumption of their datacenters, which would include everything from Google Search, to Gmail, Youtube, to every Google Cloud customer. Is it broken down by product somewhere? 30 TWh per year is equivalent to an average power consumption of 3.4 GW for everything Google does. This partnership is 3x more energy intensive. Ultimately the difference in `real value/MWh` between these two must be many orders of magnitude. [1] https://sustainability.google/reports/google-2025-environmental-report/ https://sustainability.google/reports/google-2025-environmen...
  - onlyrealcuzzo 1y ago
    Data centers typically use 60% (or less) on average of their max rating. You over-provision so that you (almost) always have enough compute to meet your customers needs (even at planet scale, your demand is bursty), you're always doing maintenance on some section, spinning up new hardware and turning down old hardware. So, apples to apples, this would likely not even be 2x at 30TWh for Google.
- tmiku 1y ago
  For other readers: "15 Twh per year" is equivalent to 1.71 GW, 17.1% of the "10GW" number used to describe the deal.
  - mNovak 1y ago
    This is ignoring the utilization factor though. Both Google and OpenAI have to overprovision servers for the worst case simultaneous users. So 1.71 GW average doesn't tell use the maximum instantaneous GW capacity of Google -- if we pull a 4x out of the hat (i.e. peak usage is 4x above average), it becomes ~7 GW of available compute. More than a "Google" of new compute is of course still a lot, but it's not many Googles' worth.
jazzyjackson 1y ago
I mean if 10GW of GPUs gets us AGI and we cure cancer than that's cool, but I do get the feeling we're just getting uncannier chatbots and fully automated tiktok influencers
- junon 1y ago
  This is also my take. I think a lot of people miss the trees for the forest (intentionally backward). AI that could find a cure for cancer isn't the driving economic factor in LLM expansion, I don't think. I doubt cancer researchers are holding their breath on this.
- yard2010 1y ago
  Current llms are just like farms. Instead of tomatoes by the pound you buy tokens by the pound. So it depends on the customers.
- rebolek 1y ago
  And when it’s built, Sam Altman will say: We are so close, if we get 10TW, AGI will be here next year!
diego_sandoval 1y ago
Do you think the existence of NYC and Chicago is insanely wasteful?

deleted 1y ago

[deleted]

I dunno. Google is pretty useful. It uses >15 TWh per year. Theoretically, AI could be more useful than that. Theoretically, in the future, it could be the same amount of useful (or much more) with substantially less power usage. It could be a short-term crunch to pull-forward (slightly) AI advancements. Additionally, I'm extremely skeptical they'll actually turn on this many chips using that much energy globally in a reasonable time-frame. Saying that you're going to make that kind of investment is one thing. Actually getting the power for it is easier said than done. VC "valuations" are already a joke. They're more like minimum valuations. If OpenAI is worth anywhere near it's current "valuations", Nvidia would be criminally negligent NOT to invest at a 90% discount (the marginal profit on their chips).

deleted 1y ago
[deleted]
Capricorn2481 1y ago
Does Google not include AI?
dns_snek 1y ago
According to Google's latest environmental report[1] that number was 30 TWh per year in 2024, but as far as I can tell that's their total consumption of their datacenters, which would include everything from Google Search, to Gmail, Youtube, to every Google Cloud customer. Is it broken down by product somewhere? 30 TWh per year is equivalent to an average power consumption of 3.4 GW for everything Google does. This partnership is 3x more energy intensive. Ultimately the difference in `real value/MWh` between these two must be many orders of magnitude. [1] https://sustainability.google/reports/google-2025-environmental-report/ https://sustainability.google/reports/google-2025-environmen...
- onlyrealcuzzo 1y ago
  Data centers typically use 60% (or less) on average of their max rating. You over-provision so that you (almost) always have enough compute to meet your customers needs (even at planet scale, your demand is bursty), you're always doing maintenance on some section, spinning up new hardware and turning down old hardware. So, apples to apples, this would likely not even be 2x at 30TWh for Google.
tmiku 1y ago
For other readers: "15 Twh per year" is equivalent to 1.71 GW, 17.1% of the "10GW" number used to describe the deal.
- mNovak 1y ago
  This is ignoring the utilization factor though. Both Google and OpenAI have to overprovision servers for the worst case simultaneous users. So 1.71 GW average doesn't tell use the maximum instantaneous GW capacity of Google -- if we pull a 4x out of the hat (i.e. peak usage is 4x above average), it becomes ~7 GW of available compute. More than a "Google" of new compute is of course still a lot, but it's not many Googles' worth.

jazzyjackson 1y ago

I mean if 10GW of GPUs gets us AGI and we cure cancer than that's cool, but I do get the feeling we're just getting uncannier chatbots and fully automated tiktok influencers

junon 1y ago
This is also my take. I think a lot of people miss the trees for the forest (intentionally backward). AI that could find a cure for cancer isn't the driving economic factor in LLM expansion, I don't think. I doubt cancer researchers are holding their breath on this.
yard2010 1y ago
Current llms are just like farms. Instead of tomatoes by the pound you buy tokens by the pound. So it depends on the customers.
rebolek 1y ago
And when it’s built, Sam Altman will say: We are so close, if we get 10TW, AGI will be here next year!

diego_sandoval 1y ago

Do you think the existence of NYC and Chicago is insanely wasteful?