4 ms·
English only, as usual for NLG
by pixiemaster 6y ago
English only, as usual for NLG
- qayxc 6y agoIn this particular case it's excusable as English is the Lingua Franca of science today. Used to be Latin, then French and German, now it's English. No big deal IMO. In fact I kind of like the way this is going since it represents a fantastic opportunity for NL researchers to stand out simply by publishing research and corpora focused exclusively on low-resource languages and non-English/Mandarin in general. It is also important to note that most of the ML research in the field is pretty much language agnostic and is concerned with general concept such as efficient en-/decoding [1], training methods [2], and even stealing pre-trained weights from APIs (like GPT-2 or even 3) without paying for training [3] :) It's just easier to get your hands on and verify English corpora, results and pre-trained models for reproducibility than say Mongolian or Gaelic so that's a factor, too. [1] https://arxiv.org/pdf/1904.09751.pdf https://arxiv.org/pdf/1904.09751.pdf [2] https://arxiv.org/pdf/2003.10555.pdf https://arxiv.org/pdf/2003.10555.pdf [3] https://arxiv.org/pdf/1910.12366.pdf https://arxiv.org/pdf/1910.12366.pdf