Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
zachooz
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
zachooz
1y ago
If each character were represented by its own token, there would be no need to "blur" anything, since the model would receive a 1:1 mapping between input vectors and individual characters. I never claimed that character-level reas
2.
▲
by
zachooz
1y ago
A sequence of characters is grouped into a "token." The set of all such possible sequences forms a vocabulary. Without loss of generality, consider the example: strawberry -> straw | ber | ry -> 3940, 3231, 1029 -> [vecto
3.
▲
by
zachooz
2y ago
An introduction to general relativity spacetime and geometry by Sean Carrol