3 ms·

what if we ask it to translate an undeciphered language

• dougmwne 3y ago
  It produces basically random translations. This is covered in the 0-shot case where no translation manual was included in the context. Due to how rare this language is, it’s essentially untranslated in the training corpus.
• famouswaffles 3y ago
  If you mean to dump random passages of text with no parallel corpora or grammar instructions then it won't do better than random. That said, I think that if you gave a LLM language text to predict during training, I believe that even if no parallel corpora exists during training, we could have a LLM that could still translate that language to some other language it also trained on.
  • seydor 3y ago
    What if we added a bunch of linguistic analysis books or something
• lukemelas 3y ago
  Author of the Kalamang paper here. We’ve thought about this a good amount (e.g. there are interesting Mesoamerican scripts), but ultimately we decided to work on low-resource languages, as they’re much more useful. It’s also possible to use them as an evaluation benchmark, which isn’t really possible if nobody speaks the language. We’d like to expand the scope beyond Kalamang, though, and maybe at some point we’ll investigate an undeciphered language as well.