I guess token length is indirectly determined by language frequency in the training set, and it would be possible to train a model on machine translated trainin

I guess token length is indirectly determined by language frequency in the training set, and it would be possible to train a model on machine translated training data only to combat that (or maybe to force tokenization to overrepresent languages other than English?), but there’s no way that would be economical, and inference would just be accordingly more expensive to recoup that effort.