Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
ycomby321
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
ycomby321
1y ago
Something to consider for deploying LLMs on the ANE is: https://github.com/pytorch/executorch/tree/main/examples/app... The model does have some limitations (e.g., need for QAT for 4-bit quantizatio