4 ms·How much vram do you need to fit 4bit quantization model?by ranguna 3y agoHow much vram do you need to fit 4bit quantization model?ianbutler 3y ago28gb, I'm running on an RTX 6000 Ada with 49gbranguna 3y agoCool, thanks!