3 ms·
I wonder if any GPU is powering down chips or banks like you can on PC. They all have MMUs right? So you could defrag all in-use memory to fewer refresh domain
by bobmcnamara 2y ago
I wonder if any GPU is powering down chips or banks like you can on PC.
They all have MMUs right? So you could defrag all in-use memory to fewer refresh domains too.
- JackYoustra 2y agoyou can validate this yourself: if you have access to an A/H100, allocate a 30gb tensor and do nothing - you'll see nvidia-smi's reported wattage go up by a watt or so
- wtallis 2y agoThat doesn't prove anything. Allocating a second 30GB chunk and seeing the power go up another Watt would be more convincing.
- wtallis 2y agoGPUs will drop memory clocks dynamically, with at least one supported clock speed that's intended to be just fast enough to support scanning out the framebuffer. I haven't seen any indication that anybody is dynamically offlining VRAM capacity.