3 ms·
Does your technique break the cache? edit: Thanks.
by esafak 8mo ago
Does your technique break the cache? edit: Thanks.
- mksglu 8mo agoNope. The raw data never enters the conversation history in the first place, so there's nothing to invalidate. Tool output runs in a sandbox, a short summary comes back, and the full data sits in a local FTS5 index. The conversation cache stays intact because the context itself doesn't change after the fact.
- doctorpangloss 8mo agoThe LLM that the "author" is using has no idea what it's talking about, and the reply you got is nonsense. @dang it's really bad lately.