4 ms·
They are solving a different problem. They are doing the "white box" translation, that is knowing good inputs and outputs. I'm talking about something more ak
by cogman10 3y ago
They are solving a different problem. They are doing the "white box" translation, that is knowing good inputs and outputs.
I'm talking about something more akin to what these researchers are doing. Without feeding the AI information about the correct translation, can we make an AI that can translate spanish to english? That is, what the researchers are trying to do with this whale translation.
- ethanbond 3y agoI see now! Interesting idea. Thanks for clarifying :)
- famouswaffles 3y agoYou don't need Parallel corpora for all language pairs in a "predict the next token" LLM. What I'm saying is that if an LLM is trained on English, French and Spanish and there is Eng to French data, you don't need Eng to Spa data to get Eng to Spa translations.
- cogman10 3y agoSpanish may have been a bad first language, but others like Korean, Icelandic, or even Russian would work as there is very little cross over or related languages. You'd have to be careful with the input data, though, as it would be easy to corrupt your dataset with translations if you try and do this fast.