3 ms·Seems weird. A 9B model would normally fit unquantised on a 24GB GPU.by regularfry 3mo agoSeems weird. A 9B model would normally fit unquantised on a 24GB GPU.