3 ms·
This didn't work well for me, no changes are ever made but maybe it's because I'm just using the 14B model.
by sureglymop 2y ago
This didn't work well for me, no changes are ever made but maybe it's because I'm just using the 14B model.
- manmal 2y agoIn case you are on a 32+GB Mac, you could try deepseek-r1-distill-qwen-32b-mlx in LM Studio. It’s just barely usable speed-wise, but gives useful results most of the time.