4 ms·
I’m pretty sure there are dozens of startups doing AI-based translation, including just general LLMs which seem to be extremely good at this already.
by ethanbond 3y ago
I’m pretty sure there are dozens of startups doing AI-based translation, including just general LLMs which seem to be extremely good at this already.
- vasco 3y agoThose are trained differently, being exposed to translations in the training. My understanding of the person you are replying to is proposing "discovering the meaning" of Spanish by just using audio without any translations in the training. Pretending we don't know Spanish as if it were an animal/alien language.
- ethanbond 3y agoAh I see now! Thanks for the clarification.
- cogman10 3y agoThey are solving a different problem. They are doing the "white box" translation, that is knowing good inputs and outputs. I'm talking about something more akin to what these researchers are doing. Without feeding the AI information about the correct translation, can we make an AI that can translate spanish to english? That is, what the researchers are trying to do with this whale translation.
- ethanbond 3y agoI see now! Interesting idea. Thanks for clarifying :)
- famouswaffles 3y agoYou don't need Parallel corpora for all language pairs in a "predict the next token" LLM. What I'm saying is that if an LLM is trained on English, French and Spanish and there is Eng to French data, you don't need Eng to Spa data to get Eng to Spa translations.
- cogman10 3y agoSpanish may have been a bad first language, but others like Korean, Icelandic, or even Russian would work as there is very little cross over or related languages. You'd have to be careful with the input data, though, as it would be easy to corrupt your dataset with translations if you try and do this fast.