4 ms·
Ah, I mixed up tokens and words (100k tokens, 75k words), the ratio of which also seems to square with the difference between the quoted number of tokens in gg
by version_five 3y ago
Ah, I mixed up tokens and words (100k tokens, 75k words), the ratio of which also seems to square with the difference between the quoted number of tokens in gg and the number of words I counted.