3 ms·
Apologies and it’s slightly lazy of me to ask, but I was under the impression that a Token was basically 4 bytes/characters of text. This seems to be implying
by robbiep 3y ago
Apologies and it’s slightly lazy of me to ask, but I was under the impression that a Token was basically 4 bytes/characters of text. This seems to be implying that there’s some differentiation between a token and conjunctions/other sort of in between words?
- forlornacorn 3y agoThat is correct.