Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
puhsu
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
KV Cache as an Agent Runtime
(research.yandex.com)
6 points
by
puhsu
3mo ago
|
1 comments
2.
▲
by
puhsu
3mo ago
I think this is an underrepresented view of what we can do with agents if we have access to the lower levels of the LLM model than the conventional API abstraction. You can mess with KV-cache to make LLMs more interactive without retraining