4 ms·4bit quantized should run on less than 9gb vram.by qeternity 4y ago4bit quantized should run on less than 9gb vram.