Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
sirdeltalot
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
sirdeltalot
3y ago
This is almost exactly half the tokens (or twice the model size) that the Chinchilla scaling laws would predict (in fact, Table 3 in the Chinchilla paper gives 3.7T tokens, almost exactly this number, as optimal for a 175B parameter model).