3 ms·
Interesting approach, I've been particularly interested in tracking and being able to understand if adding skills or tweaking prompts is making things better or
by aleksiy123 6mo ago
Interesting approach, I've been particularly interested in tracking and being able to understand if adding skills or tweaking prompts is making things better or worse.
Anyone know of any other similar tools that allow you to track across harnesses, while coding?
Running evals as a solo dev is too cost restrictive I think.
- FrankRay78 6mo agoSee the very last section in this doc for how I minimise token usage and track savings, all three plugins co-exist fine: https://github.com/FrankRay78/NetPace/blob/main/docs/agentic-software-development-workflow.md https://github.com/FrankRay78/NetPace/blob/main/docs/agentic...
- aleksiy123 6mo agoThis is very nice as well as the reference links. I’ve been having trouble with closing the loop. Going to feed into my own. Out of curiosity how have your agents evolved and metric changed.
- FrankRay78 6mo agoI haven't tracked it recently, but when I've pulled up the metrics I've generally seen about 25% token saving (sometimes higher circa 40%, depending on type of use). I've bought a max Claude plan recently, as I couldn't make enough savings to stay on the Pro plan. Perhaps most importantly, I've not seen any conflict or degradation after installing the plugins, which I've done on both Windows and Linux. Recommended, so far.