4 ms·
Caveman doesn't and cannot change the tokenizer, so the relative token count differences by input category will remain unchanged.
by Majromax 6mo ago
Caveman doesn't and cannot change the tokenizer, so the relative token count differences by input category will remain unchanged.