FLOPs utilization is arguably the industry standard metric for efficiency right now and it should be a good first approximation of how much performance is left

FLOPs utilization is arguably the industry standard metric for efficiency right now and it should be a good first approximation of how much performance is left on the table. But if you mean the reported utilization in nvtop is misleading I completely agree (as someone who uses it daily). I’ve been meaning to dig into the source/docs to see what’s going on. The power usage seems to be a more reliable indicator of actual hardware utilization, at least on nvidia gear.