4 ms·

DC power demand is anything but constant. This is getting worse with ML clusters. There's an entire cottage industry focused on optimizing power utilization. Th

DC power demand is anything but constant. This is getting worse with ML clusters. There's an entire cottage industry focused on optimizing power utilization. There are huge incentives for DC operators who can guarantee consistent high power utilization.

zrm 3y ago
> This is getting worse with ML clusters. Is it? What causes there to be unused capacity when there is currently so much demand for training?
- deelowe 3y ago
  Training workloads are highly variable and mostly consistent across the cluster (all systems ramp up and down at the same time).