2 ms·
Not sure if there's any way to run Prism's fork of llama.cpp inside LM Studio. The fork runs fine for me. The model gets very notably stuck in a reasoning loop
by dofm 3mo ago
Not sure if there's any way to run Prism's fork of llama.cpp inside LM Studio.
The fork runs fine for me. The model gets very notably stuck in a reasoning loop on one of my simple tests, though it might be that it has the same issues with setting reasoning effort high.
On my M1 Max I still think the MoE Qwen 3.6 and Gemma 4 models are the best options. And I am far from convinced that the 35B is actually worse; it gets stuck in reasoning loops much less often than 27B in my experience.