3 ms·That is exactly how they work.by qsera 8mo agoThat is exactly how they work.astrange 8mo agoNo, a token is not a word.qsera 8mo agoI mean, it is some text.astrange 8mo agoHow do you get from a piece of text smaller than a word to an entire coherent sentence?