3 ms·Yeah I should have been more specific - Qwen 8b at a 5_K_M quant worked very well.by vunderba 1y agoYeah I should have been more specific - Qwen 8b at a 5_K_M quant worked very well.