3 ms·I had no problems running the 32b at q4 quantization with 24GB of ram.by buyucu 2y agoI had no problems running the 32b at q4 quantization with 24GB of ram.