5 ms·A minor correction: a token is 3/4 of a word. ie. it’s slightly smaller than a word, not larger.by MattRix 4y agoA minor correction: a token is 3/4 of a word. ie. it’s slightly smaller than a word, not larger.