3 ms·
The way I think about it: A token can be one to many bytes long, so they can be longer or shorter than a single character.
by cubefox 3y ago
The way I think about it: A token can be one to many bytes long, so they can be longer or shorter than a single character.