4 ms·
What about energy consumption as a proxy for it ?
by aprdm 1y ago
What about energy consumption as a proxy for it ?
- villgax 1y agonot a good estimator but still roughly good, ambient temps/neighboring cards alone might influence this more than workloads
- sailingparrot 1y agoDefinitely a better high level metric than nvidia-smi, and probably fine if you just want to get a very coarse idea of whether or not your are using the GPUs reasonably at all. But when you get to the point where you care about a few percentage points of utilisation it's just not reliable enough as many things can impact energy consumption both ways. E.g. had a case were the GPU cluster we were using wasn't being cooled well enough, so you would gradually see power draw getting lower and lower as the GPUs were throttling themselves to not overheat. You can also find cases were energy consumption is high but MFU/HFU isn't, like memory intensive workloads
- JackYoustra 1y agoiirc most of the energy comes from memory IO not arithmetic, so it's still not great. A better direction, though.