4 ms·
> The model was trained on over 1,800 languages I've never really considered how models treat languages. Would these all be siloed or are they made equivalent
by beardyw 1y ago
> The model was trained on over 1,800 languages
I've never really considered how models treat languages. Would these all be siloed or are they made equivalent at tokenization into one model? Anyone know?