I have to check, something does indeed seem weird, especially with the PC freezing like that. Maybe it runs on the CPU. > quantized version Yes, it is 4bit qua

I have to check, something does indeed seem weird, especially with the PC freezing like that. Maybe it runs on the CPU. > quantized version Yes, it is 4bit quantized, but still has 24.6GB