Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
ridethelightnin
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
ridethelightnin
10mo ago
This has so many unintended consequences for LLM over the next four years I would think. "JavaScript" tokenizes to 2 tokens (BPE). "ECMAScript" tokenizes to 3. No biggie here. But the real cost isn't training—it