3 ms·
If it were, I can in theory see situations where improving content cleanliness is worth blowing away the KV cache. But I absolutely can't see how feeding the e
by unholiness 4mo ago
If it were, I can in theory see situations where improving content cleanliness is worth blowing away the KV cache.
But I absolutely can't see how feeding the entire context into a more expensive model multiple times per task, just to propose context edits that might indirectly help, could ever be worthwhile.