Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
dramlord
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
4 ms
·
1.
▲
by
dramlord
3y ago
You can amortize memory loading with large continuous batching. I imagine more compute would help the problem for certain workloads like speculative decoding