3 ms·
Smaller, dumber models are faster than bigger, slower ones. What model do you find fast enough and smart enough?
by staticman2 2y ago
Smaller, dumber models are faster than bigger, slower ones.
What model do you find fast enough and smart enough?
- Matl 2y agoNot OP but I am finding the Qwen 2.5 32b distilled with DeepSeek R1 model to be a good speed/smartness ratio on the M4 Pro Mac Mini.
- a1o 2y agoHow much RAM?
- bastardoperator 2y agoI'm running the same exact models.