3 ms·
For those commenting on the long reasoning, it may be interesting to know that the reasoning effort is set to xhigh by default [0]. Other possible values are me
by c7b 2mo ago
For those commenting on the long reasoning, it may be interesting to know that the reasoning effort is set to xhigh by default [0]. Other possible values are medium, low and none. Flag for changing it in llama.cpp below, but note that the long reasoning seems to contribute a great deal to the quality.
--chat-template-kwargs '{"preserve_thinking":true,"reasoning_effort":"medium"}'
[0] https://unsloth.ai/docs/models/qwen3.8#thinking--preserve-thinking https://unsloth.ai/docs/models/qwen3.8#thinking--preserve-th...