3 ms·
Nice, which model quantization is this? Is it on huggingface?
by Xeoncross 26d ago
Nice, which model quantization is this? Is it on huggingface?
- spider-mario 26d agoMTPLX is this software: https://github.com/youssofal/MTPLX https://github.com/youssofal/MTPLX I tried it with the author’s 4-bit quant of Qwen 3.8 27B: https://huggingface.co/Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed https://huggingface.co/Youssofal/Qwen3.8-27B-MTPLX-Optimized... (but no need to download it manually; MTPLX will ask which one you want).