3 ms·

At what impact to the environment? SV’s obsession with bitcoin has been an ecological disaster. Fueling this arms race is insane. Monopolizing green power for A

At what impact to the environment? SV’s obsession with bitcoin has been an ecological disaster. Fueling this arms race is insane. Monopolizing green power for AI crap that hallucinates, gives mediocre and incorrect answers, is like getting life advice from a drunk bar patron.

snapcaster 2y ago
When you were growing up, did you ever see people from previous generations just not "get it" when new technology comes out and make comments like "its worthless, just a novelty"? Did you ever expect to become one of those people?
- mateus1 2y ago
  That is a pretty vapid ad hominem. Try to be more constructive next
  - snapcaster 2y ago
    It's responding to a pretty tired vapid comment, with all the "easy but dumb take" talking points: 1. waaah stop using electricity in ways i don't like 2. implying chatgpt isn't very useful in a wide variety of situations 3. randomly bringing crypto into it as if bitcoin and AI have anywhere close to the same utility
  - halJordan 2y ago
    Frankly "Youre just making an ad hominem" is itself an ad hominem attack & "Youre just being unconstructive" is also an ad hominem attack. So you've established they're useful in a rhetorical argument and we've established they're applicable to this thread. If you're allowed to use them, the other commenter is allowed to use them.
    - mateus1 2y ago
      Pointing out a phallacy is not an ad hominem. It’s attacking the argument, literally.
- SkyPuncher 2y ago
  That’s an entirely baseless attack. Not really the type of discussion that’s appropriate for HN
rhaps0dy 2y ago
I was curious so I tried to answer this question --- Training Llama 3 models emitted 2290 tons CO2e (https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md), and took 7.7 million GPU hours. Those GPU hours are for H100s, which consume 700W. So the conversion is approximately 2290 / (7.7e6 * 3600 * 700 / 1e9) ~= 0.12 tons CO2e per GPU-gigajoule. A100s (what Huggingface offers) consume 400W (https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...) and cost $2.21/hour (in e.g. CoreWeave https://www.coreweave.com/gpu-cloud-pricing https://www.coreweave.com/gpu-cloud-pricing). So $10 million in H100s buys you ($10e6 / $2.21/h * 3600s/h) * 400W ~= 6515 Gigajoules in GPU-hours. So Huggingface's offering will emit ~781 tons CO2e. Less if they've inflated the value of the compute they provide, which they have an incentive to do, but let's round to 800 tons. --- According to https://www.carbonindependent.org/22.html https://www.carbonindependent.org/22.html, one Boeing-737-400 flying for 926km emits (3.61 tons fuel/flight * 3.15(g CO2e / g fuel)) = 11.37 tons CO2e . So $10million in compute is like ~72 Boeing-737-400 international flights. --- Every day the FAA (so only in the USA) handles, on average, 45,000 flights (https://www.faa.gov/air_traffic/by_the_numbers https://www.faa.gov/air_traffic/by_the_numbers). If only 1% of these are international (very rough calculation), the total amount of compute released by this Huggingface announcement is like 16% of one day's USA international flights. --- This may sound like very little or like a lot to you.

snapcaster 2y ago

When you were growing up, did you ever see people from previous generations just not "get it" when new technology comes out and make comments like "its worthless, just a novelty"? Did you ever expect to become one of those people?

mateus1 2y ago
That is a pretty vapid ad hominem. Try to be more constructive next
- snapcaster 2y ago
  It's responding to a pretty tired vapid comment, with all the "easy but dumb take" talking points: 1. waaah stop using electricity in ways i don't like 2. implying chatgpt isn't very useful in a wide variety of situations 3. randomly bringing crypto into it as if bitcoin and AI have anywhere close to the same utility
- halJordan 2y ago
  Frankly "Youre just making an ad hominem" is itself an ad hominem attack & "Youre just being unconstructive" is also an ad hominem attack. So you've established they're useful in a rhetorical argument and we've established they're applicable to this thread. If you're allowed to use them, the other commenter is allowed to use them.
  - mateus1 2y ago
    Pointing out a phallacy is not an ad hominem. It’s attacking the argument, literally.
SkyPuncher 2y ago
That’s an entirely baseless attack. Not really the type of discussion that’s appropriate for HN

rhaps0dy 2y ago

I was curious so I tried to answer this question --- Training Llama 3 models emitted 2290 tons CO2e (https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md), and took 7.7 million GPU hours. Those GPU hours are for H100s, which consume 700W. So the conversion is approximately 2290 / (7.7e6 * 3600 * 700 / 1e9) ~= 0.12 tons CO2e per GPU-gigajoule. A100s (what Huggingface offers) consume 400W (https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...) and cost $2.21/hour (in e.g. CoreWeave https://www.coreweave.com/gpu-cloud-pricing https://www.coreweave.com/gpu-cloud-pricing). So $10 million in H100s buys you ($10e6 / $2.21/h * 3600s/h) * 400W ~= 6515 Gigajoules in GPU-hours. So Huggingface's offering will emit ~781 tons CO2e. Less if they've inflated the value of the compute they provide, which they have an incentive to do, but let's round to 800 tons. --- According to https://www.carbonindependent.org/22.html https://www.carbonindependent.org/22.html, one Boeing-737-400 flying for 926km emits (3.61 tons fuel/flight * 3.15(g CO2e / g fuel)) = 11.37 tons CO2e . So $10million in compute is like ~72 Boeing-737-400 international flights. --- Every day the FAA (so only in the USA) handles, on average, 45,000 flights (https://www.faa.gov/air_traffic/by_the_numbers https://www.faa.gov/air_traffic/by_the_numbers). If only 1% of these are international (very rough calculation), the total amount of compute released by this Huggingface announcement is like 16% of one day's USA international flights. --- This may sound like very little or like a lot to you.