4 ms·Usually around 5 GB for a 7B 4-bit quantized model.by dchest 3y agoUsually around 5 GB for a 7B 4-bit quantized model.