3 ms·
I can't Gemma4 to actually finish a turn properly, it's always ending abruptly or making malformed tool calls. It's probably something I've misconfigured in oML
by nozzlegear 4mo ago
I can't Gemma4 to actually finish a turn properly, it's always ending abruptly or making malformed tool calls. It's probably something I've misconfigured in oMLX or Opencode.
- clusterhacks 4mo agoHuh. Same problem, and I run with llama.cpp. In my case, Gemma4-31B (4-bit quant though) will just stop sometimes.
- acrispino 4mo agopossibly a problem with the chat template https://huggingface.co/google/gemma-4-31B-it/discussions/118 https://huggingface.co/google/gemma-4-31B-it/discussions/118
- anon373839 4mo agoSame problem with Gemma 4 + oMLX + OpenCode. The thinking and tool calling seems to be parsed fine in other clients such as Open WebUI. This really shouldn’t even matter because the client isn’t responsible for parsing the output, but it’s happening anyway.