3 ms·
Anyone mentioned training one (1) AI model creates as much CO2 as 5 cars over their life time...??? Nope? Just saying....
by cjbenedikt 7y ago
Anyone mentioned training one (1) AI model creates as much CO2 as 5 cars over their life time...??? Nope? Just saying....
- dTal 7y agoHow big of an AI model? By my figuring, a car uses about a thousand gigajoules, or $20,000 worth of gasoline, over its lifetime, American gas prices. Depending on where you buy your electricity, that comes out to 10 to 20 grand's worth of power (gasoline is relatively expensive per joule). So this figure implies that training an AI model costs 100 grand in electricity. Is that right? Because I thought "training an AI model" was more of a "1 week on a single GPU" kind of thing.
- imtringued 7y agoThe comparison is completely arbitrary. Big AI models require more resources than economy cars because an AI model can serve millions of users whereas the economy car only serves one. What if we stop talking about economy cars? It is only fair to compare a "lamborghini" AI model to a real lamborghini and suddenly the situation is reversed.
- hedora 7y agoWhere did you get this number? A really, really big (like the biggest FAANG had last year) ML cluster would use at most four or five DGX-N’s to train a model, because that is the current scaling limit for CNNs. Each draw 3500W: https://docs.nvidia.com/dgx/dgx1-user-guide/introduction-to-dgx1.html#topic_hwspec-power https://docs.nvidia.com/dgx/dgx1-user-guide/introduction-to-... 3500 * 5 is 17,500W. A US space heater maxes out at 1600 watts. Training for a week (5 days) is 2100 kWh, which is less than 60 gallons of gasoline, or 2-6 tanks of gas, depending on your vehicle: https://www.convertunits.com/from/kWh/to/gallon+%5BU.S.%5D+of+automotive+gasoline https://www.convertunits.com/from/kWh/to/gallon+%5BU.S.%5D+o...