3 ms·A detailed comparison between GPTQ, AWQ, EXL2, q4_K_M, q4_K_S, and load_in_4bit3 points by RossBencina 3y ago