3 ms·
This happens all the time and drives me bananas. It seems to be regular file edits rather than parallel tool calls. I'm sitting on 1.6m cache write even now w
by apt-apt-apt-apt 2mo ago
This happens all the time and drives me bananas.
It seems to be regular file edits rather than parallel tool calls.
I'm sitting on 1.6m cache write even now with 468k in /context. It drives my session costs above $100 regularly.
Can someone from Anthropic look into this?
- Phemist 2mo agoIncentives to optimize cache-usage are only aligned between anthropic and you, dear user, when there is not enough compute available to serve the tokens fresh. Apparently enough compute is now available that frugal usage is no longer a requirement and user cost/profit maximization is now the name of the game. I would expect to see more and more "cache-busting" strategies implemented in order to both eek out marginal performance increases and to heavily increase profit.