4 ms·

H100s consume like 350W. 3000 H100s = 350kW 350*0.2h = 70kWh, about $20 at $0.3/kWh (lets assume data centers have expensive electrical costs).

SushiHippie 3y ago
Ah Thanks! Taking the data from here[0] for the USA, this would be about 25,69kg of CO2. [0] https://ourworldindata.org/grapher/carbon-intensity-electricity https://ourworldindata.org/grapher/carbon-intensity-electric...
- nl 3y ago
  If you are on GCP you can choose low carbon data centers: https://cloud.google.com/sustainability/region-carbon https://cloud.google.com/sustainability/region-carbon
- alwa 3y ago
  Which, per the EPA [0], is roughly the tailpipe CO2 you’d emit by burning a little under 3 gallons of gas in your car, right? Which is to say, driving 65ish miles in the US [1]? It amazes me that computational feats of this magnitude can be so energy efficient in the scheme of things. [0] https://www.epa.gov/greenvehicles/tailpipe-greenhouse-gas-emissions-typical-passenger-vehicle#burning https://www.epa.gov/greenvehicles/tailpipe-greenhouse-gas-em... [1] https://www.epa.gov/greenvehicles/tailpipe-greenhouse-gas-emissions-typical-passenger-vehicle#:~:text=This%20assumes%20the%20average%20gasoline,around%2011%2C500%20miles%20per%20year https://www.epa.gov/greenvehicles/tailpipe-greenhouse-gas-em....
  - NhanH 3y ago
    It’s not that surprising actually, computation moves nothing and all energy has to turn into heat. If computation would use as much energy as moving physical objects, the heat would burn everything down
- YetAnotherNick 3y ago
  Or about 3s of 747 cruise[0] [0]: https://www.carbonindependent.org/22.html#:~:text=At%20a%20cruising%20speed%20of,Distance%3A%205556%20km https://www.carbonindependent.org/22.html#:~:text=At%20a%20c...
shaklee3 3y ago
You can't really use 350W. It's very rare for a workload to consume the full TDP.
- pinkcan 3y ago
  this is napkin math, for sure there are other components in the system that do not directly contribute to the computation – cooling systems, DC lights

SushiHippie 3y ago

Ah Thanks! Taking the data from here[0] for the USA, this would be about 25,69kg of CO2. [0] https://ourworldindata.org/grapher/carbon-intensity-electricity https://ourworldindata.org/grapher/carbon-intensity-electric...

nl 3y ago
If you are on GCP you can choose low carbon data centers: https://cloud.google.com/sustainability/region-carbon https://cloud.google.com/sustainability/region-carbon
alwa 3y ago
Which, per the EPA [0], is roughly the tailpipe CO2 you’d emit by burning a little under 3 gallons of gas in your car, right? Which is to say, driving 65ish miles in the US [1]? It amazes me that computational feats of this magnitude can be so energy efficient in the scheme of things. [0] https://www.epa.gov/greenvehicles/tailpipe-greenhouse-gas-emissions-typical-passenger-vehicle#burning https://www.epa.gov/greenvehicles/tailpipe-greenhouse-gas-em... [1] https://www.epa.gov/greenvehicles/tailpipe-greenhouse-gas-emissions-typical-passenger-vehicle#:~:text=This%20assumes%20the%20average%20gasoline,around%2011%2C500%20miles%20per%20year https://www.epa.gov/greenvehicles/tailpipe-greenhouse-gas-em....
- NhanH 3y ago
  It’s not that surprising actually, computation moves nothing and all energy has to turn into heat. If computation would use as much energy as moving physical objects, the heat would burn everything down
YetAnotherNick 3y ago
Or about 3s of 747 cruise[0] [0]: https://www.carbonindependent.org/22.html#:~:text=At%20a%20cruising%20speed%20of,Distance%3A%205556%20km https://www.carbonindependent.org/22.html#:~:text=At%20a%20c...

shaklee3 3y ago

You can't really use 350W. It's very rare for a workload to consume the full TDP.

pinkcan 3y ago
this is napkin math, for sure there are other components in the system that do not directly contribute to the computation – cooling systems, DC lights