3 ms·
It depends. Let’s say I’ve already worked on something, so the KV cache is already there. If I use /clear, I’ll have to do that work again. And yes, the KV ca
by cute_boi 3mo ago
It depends.
Let’s say I’ve already worked on something, so the KV cache is already there. If I use /clear, I’ll have to do that work again.
And yes, the KV cache will remain available for one hour, but who knows when this claude api will recover? We might forget about it, and when we come back after an hour—boom - we’ll be charged for cold writes.