2 ms·
Not really? Google's sustainability report gives datacenter energy usage and PUE, and you can approximately apportion energy usage per site to each site based o
by jeffbee 3y ago
Not really? Google's sustainability report gives datacenter energy usage and PUE, and you can approximately apportion energy usage per site to each site based on its size. David Patterson and his team have issued a number of papers and talks with precise figures for various ML tasks, such as "Carbon Emissions and Large Neural Network Training", "The carbon footprint of machine learning training will plateau, then shrink", and "GLaM: Efficient Scaling of Language Models with Mixture-of-Experts".