3 ms·
You don't need Parallel corpora for all language pairs in a "predict the next token" LLM. What I'm saying is that if an LLM is trained on English, French and S
by famouswaffles 3y ago
You don't need Parallel corpora for all language pairs in a "predict the next token" LLM.
What I'm saying is that if an LLM is trained on English, French and Spanish and there is Eng to French data, you don't need Eng to Spa data to get Eng to Spa translations.
- cogman10 3y agoSpanish may have been a bad first language, but others like Korean, Icelandic, or even Russian would work as there is very little cross over or related languages. You'd have to be careful with the input data, though, as it would be easy to corrupt your dataset with translations if you try and do this fast.