3 ms·
Perseus: Removing Energy Bloat from Large Model Training
- gardenfelder 3y ago"Training large AI models on numerous GPUs consumes a massive amount of energy. We observe that not all energy consumed during training directly contributes to end-to-end training throughput, and a significant portion can be removed without slowing down training, which we call energy bloat. "