Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
maxul
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
maxul
3y ago
PowerInfer is a high-speed Large Language Model (LLM) inference engine on a personal computer (PC) equipped with a single consumer-grade GPU. The key underlying the design of PowerInfer is exploiting the high locality inherent in LLM infere
2.
▲
by
maxul
3y ago
Debugging a blackbox is challenging when a developer lacks access to the bug report, which contains sensitive user data. This is not uncommon, most commercial software, such as Windows and Office, generate anonymized bug reports from users&