4 ms·
Read through it an I'm curious whether setting the date and cmd on every system prompt call will cause the cache to invalidate. I guess the cache would only be
by ppeetteerr 3mo ago
Read through it an I'm curious whether setting the date and cmd on every system prompt call will cause the cache to invalidate.
I guess the cache would only be invalid if the day changed or the root directory, which would technically happen infrequently enough.
- bel8 3mo agoI get 95% or more cache hit rate with pi and DeepSeek or MiMo so it doesn't invalidate. But I'll investigate how that works in a session. You got me curious.