3 ms·
Some of us also worry about energy consumption
by agilob 2y ago
Some of us also worry about energy consumption
- talldayo 2y agoThey idle at pretty low wattages, and since the bulk of the TDP is rated for raster workloads you usually won't see them running at full-power on compute workloads. My 300w 3070ti doesn't really exceed 100w during inference workloads. Boot up a 1440p video game and it's a different story altogether, but for inference and transcoding those 3060s are some of the most power efficient options on the consumer market.
- aljarry 2y agoInteresting, my 3060 uses 150-170W with 14B model on Ollama, according to nvidia-smi.