3 ms·
I had roughly the same performance on M3 Max 64: ~30 tokens/sec. Which is not terrible, but with the latest Lightning MTP optimization I am getting ~100 tokens/
by anon373839 3mo ago
I had roughly the same performance on M3 Max 64: ~30 tokens/sec. Which is not terrible, but with the latest Lightning MTP optimization I am getting ~100 tokens/sec with Qwen 3.6 35B-A3B.
- ch_sm 3mo agoWHAT. that‘s amazing. thanks so much for sharing, i‘ve been looking for ways to speed a3b up for days. It‘s 11pm here but i‘ll try this right now
- anon373839 3mo agoI’m using the new oQe quants in case that matters.
- ch_sm 3mo agoi see! would you mind sharing your model string?
- anon373839 3mo ago[dead]