Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
austegard
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
austegard
3y ago
Faster token generation at 1/10th the cost per token seems like a great indication, unless they're just fleecing us with -003
2.
▲
by
austegard
3y ago
This falls in the category of circumstantial, possibly just coincidental evidence of Chat being a "compressed" model (quantized, pruned, or distilled): the hard prompt from this paper: Compress, Then Prompt: Improving Accuracy-Eff