4 ms·
I would like to see their method compared quantitatively to the best llama.cpp methods. IQ3_S has a similar bpw and pretty high quality. I wonder if they didn'
by Hugsun 2y ago
I would like to see their method compared quantitatively to the best llama.cpp methods. IQ3_S has a similar bpw and pretty high quality.
I wonder if they didn't stretch the truth using the phrase "without loss in accuracy".