3 ms·Seems weird. A 9B model would normally fit unquantised on a 24GB GPU.by regularfry 5mo agoSeems weird. A 9B model would normally fit unquantised on a 24GB GPU.