3 ms·
I've been going off of power draw in nvidia-smi as a proxy of util, doesn't require additional setup or code changes.
by ipsum2 3y ago
I've been going off of power draw in nvidia-smi as a proxy of util, doesn't require additional setup or code changes.
- KeplerBoy 3y agoThat's hard to argue with. Of course power draw is a direct measure of hardware utilization, but it doesn't translate very well to a measure of GPU Code efficiency. Often you can squeeze out another order of magnitude of performance by rewriting the kernel and the power draw will always stay capped at whatever the maximum is. I'd say GPU power consumption is interesting if you're CPU bound and struggling to feed the GPU enough data and/or tasks.