3 ms·
Checkout MTPLX. I use the Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed model and I get around 12 tok/s on a 36GB MBP.
by suoloordi 2mo ago
Checkout MTPLX. I use the Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed model and I get around 12 tok/s on a 36GB MBP.
- dofm 2mo agoI still haven't tested MTPLX and the memory of reading about it had drifted out of my brain like so many things have, so thanks! I really must.