3 ms·
perhaps whitespace token is considered a word: 2 words 1 spaces = 3 tokens 3 words 2 spaces = 5 tokens 4 words 3 spaces = 7 tokens ... maybe?
by _proofs 6y ago
perhaps whitespace token is considered a word:
2 words 1 spaces = 3 tokens
3 words 2 spaces = 5 tokens
4 words 3 spaces = 7 tokens
...
maybe?