Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
gauravapiscean
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
gauravapiscean
2mo ago
Here is the repo link: https://github.com/gauravapiscean/agentic-kv-cache
2.
▲
LRU is harder to beat than the KV-cache papers suggest
(github.com)
108 points
by
gauravapiscean
2mo ago
|
58 comments
3.
▲
by
gauravapiscean
2mo ago
Author here. Context for why I did this: There's a growing literature arguing LRU is the wrong eviction policy for agentic LLM serving, because agent sessions idle and LRU can't distinguish a paused session from a dead one. I foun