4 ms·
Good summary blog: https://maloyan.xyz/blog/running-qwen-locally-mac-mini-m4 https://maloyan.xyz/blog/running-qwen-locally-mac-mini-m4
by mathgeek 3mo ago
Good summary blog: https://maloyan.xyz/blog/running-qwen-locally-mac-mini-m4 https://maloyan.xyz/blog/running-qwen-locally-mac-mini-m4
- coredog64 3mo ago> That's not hypothetical — it's a real measurement on the base model Mac Mini. Hmmm
- kzrdude 3mo agoYes, I tried out that blog post and concluded that it has llm-written formulations, weird ordering of its alternatives, and LM Studio is the "Step" in its list that works best. The mmap trick certainly does not work.