4 ms·13b q5 llama report „total VRAM used: 8321 MB” so 3bit will most likely fit into 8GB.by TeddyDD 3y ago13b q5 llama report „total VRAM used: 8321 MB” so 3bit will most likely fit into 8GB.