3 ms·
I just loaded two models of different quants into LM Studio: qwen 2.5 coder 1.5b @ q4_k_m: 1.21 GB memory qwen 2.5 coder 1.5b @ q8: 1.83 GB memory I always a
by terhechte 2y ago
I just loaded two models of different quants into LM Studio:
qwen 2.5 coder 1.5b @ q4_k_m: 1.21 GB memory
qwen 2.5 coder 1.5b @ q8: 1.83 GB memory
I always assumed this to be the case (also because of the smaller download sizes) but never really thought about it.