hello_im_angela

5 ms·

1.
by hello_im_angela 4y ago
We represent all languages in their natural script, rather than transliterating them into a common synthetic one. Regarding Mari: extremely interesting language, exciting to hear that you are from that region. We are interested in working o
2.
by hello_im_angela 4y ago
We tokenize with the flores-200 spm model, correct. To generate from the model, check out the instructions here: https://github.com/facebookresearch/fairseq/tree/nllb/exampl...
3.
by hello_im_angela 4y ago
could you send me an email please? It's available on our paper, page 1: https://research.facebook.com/publications/no-language-left-... Regarding grants: we have offered compute grants previously with the Workshop
4.
by hello_im_angela 4y ago
sooo real. Many low-resource languages have many different natural variants, can be written in multiple scripts, don't have as much written standardization, or are mainly oral. As part of the creation of our benchmark, FLORES-200, we t
5.
by hello_im_angela 4y ago
ha yes, that's correct. If you have thoughts on specific constructed languages where having translation would really help people, let us know!
6.
by hello_im_angela 4y ago
We interviewed speakers of low-resource languages from all over the world to understand the human need for this kind of technology --- what do people actually want, how would they use it, and what's the quality they would find useful?
7.
by hello_im_angela 4y ago
We release several smaller models as well: https://github.com/facebookresearch/fairseq/tree/nllb/exampl... that are 1.3B and 615M parameters. These are usable on smaller GPUs. To create these smaller mod
8.
by hello_im_angela 4y ago
We have a full list here (copy pastable): https://github.com/facebookresearch/flores/tree/main/flores2... and Table 1 of our paper ( https://research.facebook.com/publications/no-lang
9.
by hello_im_angela 4y ago
It's an extremely difficult problem indeed. A lot of people on the team speak low-resource languages too (my native language as well!), so definitely resonate with what you're saying. My overall feeling is: yeah it's hard, an
10.
by hello_im_angela 4y ago
If you're curious to try the system yourself, it's actually being used to help Wikipedia editors write articles for low-resource language Wikipedias: https://twitter.com/Wikimedia/status/15446998509602816