3 ms·
In video games this tends to be a function of framerate, with higher FPS being more likely to produce coil whine as the GPU power draw oscillates at a higher fr
by jsheard 9mo ago
In video games this tends to be a function of framerate, with higher FPS being more likely to produce coil whine as the GPU power draw oscillates at a higher frequency. I assume there's something analogous in LLM runtimes when the outer loop spins faster or slower.
- behnamoh 9mo agoin this case, the smaller glm mxfp4 model actually runs slower than the much larger m2.1 model.
- monster_truck 9mo agothat tracks, it's not staying loaded and is buzzsawing back and forth between power states. They'll likely fix it with some power management tweaks. Had a pair of modded Vega 64s that sounded like a tiny CNC mill when they did this, but that's what ~900W will do if you let it. I haven't used a mac in a while but there's probably some values you can fuck with if you disable sip to stop it from ramping back down so aggressively, or keep it in the higher power states.