3 ms·With 4-bit quantization should take less than 40GB of VRAM/RAM.by GaggiX 3y agoWith 4-bit quantization should take less than 40GB of VRAM/RAM.