3 ms·
> My secret sauce is to use LLAMAcpp's reasoning-budget and reasoning-message that trigger cut off to overthinking with a message that says to either us subagen
by vunderba 2mo ago
> My secret sauce is to use LLAMAcpp's reasoning-budget and reasoning-message that trigger cut off to overthinking with a message that says to either us subagents or compress the context
Thanks for the tip - I like this a lot. I remember having to do a lot of tweaking to curtail Qwen QwQ-32b when it would go down an endless psychotic recursive reasoning loops as part of its "chain of reasoning."
- cyanydeez 2mo agoI tailored the agent to ao both its system prompt and budget-message align. I havent yet tailored the pruning messages, but mostly it works. Reasoning budget can also be set by client, so potentially smarter.