3 ms·Quantized 7B's can comfortably run with 8GB vramby gsuuon 3y agoQuantized 7B's can comfortably run with 8GB vram