Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
redpublic
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
by
redpublic
13d ago
If we are getting general purpose classifier, decision engine, probabilistic inference machine and likely a couple of other use cases for the fraction of latency/time/price of using SOTA LLMs for such tasks or training specialized
2.
▲
by
redpublic
2mo ago
Am I missing something or if you don’t use words loosely and clickbaitly, inference doesn’t have anything to do with CPU? All the tools and orchestration examples are not actually part of the inference. Honestly, this article is 90% fluff t