3 ms·
You'd have to look where the extra tokens are coming from. If it's using extra turns or doing extra work because a tool it ~wants is missing, then adding extra
by kadoban 1mo ago
You'd have to look where the extra tokens are coming from. If it's using extra turns or doing extra work because a tool it ~wants is missing, then adding extra things will help. Otherwise, it won't.
If it's missing guidance that would help, system prompt additions might help.
8x-10x the tokens is wild, is this for some tiny artificial benchmark? That's just too much extra for something not to be just broken.
- toasty228 1mo agoIt was a real workload from my day job, a modest merge request, I asked for a review and for an implementation plan to fix the findings, nothing crazy. It's the most simple thing I could think of that wasn't an artificial benchmark, self contained, no need to look for extra documentation, web searches, etc.
- kadoban 1mo agoYeah something must be actively broken or just an awful extension for it to have that much effect. Most things you can mess with the big effect is like, oh a thousand tokens ended up in the ~system prompt, or 10% extra or fewer work based on extra tool calls or churning through thinking or whatever. Harness stuff if it's 8x worse that's like, it's fucked and broken, something went _wrong_.