Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
Icko_
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
Icko_
1y ago
distillation and teacher-student models are definitely way older than 2024.
2.
▲
by
Icko_
1y ago
Not even that. With KV-caching, it's linear with the size of the context; and if someone figured out a way to have e.g. NlogN complexity, I imagine with KV-caching it may go down to logN complexity. (If the new algorithm permits that.)