Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
hycpax
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
hycpax
2y ago
> When a LLM outputs a word, it commits to that word, without knowing what the next word is going to be. Please, people, read before you write. Both the article and the paper explain that that’s not how it works. ‘One token at a time’ is
2.
▲
by
hycpax
2y ago
Only starts approaching PPL of AR at block size 4. May as well just use multi-token prediction with a standard AR model.