3 ms·7b runs on my 4gb vram machine (8gb memory). I.e. quantization helps a lot tooby naillo 3y ago7b runs on my 4gb vram machine (8gb memory). I.e. quantization helps a lot too