Yes its a problem for the grid and the power companies don't allow large clusters to oscillate their power like this. The solution that AI have to do during the

Yes its a problem for the grid and the power companies don't allow large clusters to oscillate their power like this. The solution that AI have to do during their training big runs is to fill in the idle time on the GPUs with dummy operations to keep the power load constant. Having capacitors would be able to save on power usage.