2 ms·
I highly doubt that. Keeping your cache warm is a good thing, caching saves compute and electricity. Cached input is cheap for a reason, it is in everyone’s m
by dannyw 3mo ago
I highly doubt that.
Keeping your cache warm is a good thing, caching saves compute and electricity.
Cached input is cheap for a reason, it is in everyone’s mutual interests to maximise cache hit rates.
- OccamsMirror 3mo agoIf that was true then Anthropic would have built this functionality in themselves.
- brookst 3mo agoThey did. On any long running query with large context, tell Claude “give me a status report every 4 minutes to keep the cache warm”. It’s entirely happy to oblige and usually says “good idea, that will keep costs down”