3 ms·Letter-by-letter tokenization increases inference and training costs and latency (as you need more tokens)by tintor 3y agoLetter-by-letter tokenization increases inference and training costs and latency (as you need more tokens)