3 ms·
Update: I'm experiencing issues with OpenCode and this model. I have built the latest llama.cpp and followed the Unsloth guide, but it's not usable at the momen
by dajonker 9mo ago
Update: I'm experiencing issues with OpenCode and this model. I have built the latest llama.cpp and followed the Unsloth guide, but it's not usable at the moment because of:
- Tool calling doesn't work properly with OpenCode
- It repeats itself very quickly. This is addressed in the Unsloth guide and can be "fixed" by setting --dry-multiplier to 1.1 or higher
- It makes a lot of spelling errors such as replacing class/file name characters with "1". Or when I asked it to check AGENTS.md it tried to open AGANTS.md
I tried both the Q4_K_XL and Q5_K_XL quantizations and they both suffer from these issues.
- eblanshey 9mo agoThere is a new update on HF: > Jan 21 update: llama.cpp fixed a bug that caused looping and poor outputs. We updated the GGUFs - please re-download the model for much better outputs.
- philippelh 9mo agoAfter re-downloading the model, do not use --dry-multiplier... and also, don't ask me how I know...
- dajonker 9mo agoYes! This update works great. Seems to be pretty good at first glance. I'll have to setup an interesting task and see how different models approach the problem.