Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
vfalbor2
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
2 ms
·
1.
▲
by
vfalbor2
5mo ago
He is talking about tokenization of different llm and comparing, and this is inacurate because you cannot compare if you dont how it tokenice the words, some tokenicer could be cheap with more tokens than other because of their features. No