> Select a granularity that keeps each unique prefix-prompt_cache_key combination below 15 requests per minute to avoid cache overflow. Why below a certain num

> Select a granularity that keeps each unique prefix-prompt_cache_key combination below 15 requests per minute to avoid cache overflow. Why below a certain number? Usually in caches a high number of requests keeps the cached bit from expiring or being replaced, no?