3 ms·

This paragraph justifies the decision, IMHO. > Collecting audio data for thousands of languages was our first challenge because the largest existing speech dat

This paragraph justifies the decision, IMHO. > Collecting audio data for thousands of languages was our first challenge because the largest existing speech datasets cover 100 languages at most. To overcome this, we turned to religious texts, such as the Bible, that have been translated in many different languages and whose translations have been widely studied for text-based language translation research. I think the choice was just between having any data at all, or not being able to support that language.

omneity 3y ago
Of course, my critique is less "This project shouldn't exist", but rather "It seems to me there are several biases that affect the performance of this project in the context it was presented in". This is a great project and an important stepping stone in a multilingual AI future.
westurner 3y ago
While AFAIU the UN: UDHR United Nations Universal Declaration of Human Rights is the most-translated document in the world, relative to the given training texts there likely hasn't been as much subjective translation analysis of UDHR. Awesome-legal-nlp links to benchmarks like LexGLUE and FairLex but not yet LegalBench; in re: AI alignment and ethics / regional law https://github.com/maastrichtlawtech/awesome-legal-nlp#benchmarks https://github.com/maastrichtlawtech/awesome-legal-nlp#bench... A "who hath done it" exercise: [For each of these things, tell me whether God, Others, or You did it:] https://twitter.com/westurner/status/1641842843973976082 https://twitter.com/westurner/status/1641842843973976082? "Did God do this?"
- sangnoir 3y ago
  The UN's UDHR likely yields <5mins of audio data in any language which is kinda useless as far as training data goes.
  - westurner 3y ago
    Compared to e.g. religious text translation, I don't know how much subjective analysis there is for UDHR translations. It's pretty cut and dry: e.g. "Equal Protection of Equal Rights" is pretty clear. "About the Universal Declaration of Human Rights Translation Project" https://www.ohchr.org/en/human-rights/universal-declaration/universal-declaration-human-rights/about-universal-declaration-human-rights-translation-project https://www.ohchr.org/en/human-rights/universal-declaration/... : > At present, there are 555 different translations available in HTML and/or PDF format. E.g. Buddhist scriptures are also multiply translated; probably with more coverage in East Asian languages. Thomas Jefferson, who wrote the US Declaration of Independence, had read into Transcendental Buddhism and FWIU is thus significantly responsible for the religious (and nonreligious) freedom We appreciate in the United States today.

omneity 3y ago

Of course, my critique is less "This project shouldn't exist", but rather "It seems to me there are several biases that affect the performance of this project in the context it was presented in". This is a great project and an important stepping stone in a multilingual AI future.

westurner 3y ago

While AFAIU the UN: UDHR United Nations Universal Declaration of Human Rights is the most-translated document in the world, relative to the given training texts there likely hasn't been as much subjective translation analysis of UDHR. Awesome-legal-nlp links to benchmarks like LexGLUE and FairLex but not yet LegalBench; in re: AI alignment and ethics / regional law https://github.com/maastrichtlawtech/awesome-legal-nlp#benchmarks https://github.com/maastrichtlawtech/awesome-legal-nlp#bench... A "who hath done it" exercise: [For each of these things, tell me whether God, Others, or You did it:] https://twitter.com/westurner/status/1641842843973976082 https://twitter.com/westurner/status/1641842843973976082? "Did God do this?"

sangnoir 3y ago
The UN's UDHR likely yields <5mins of audio data in any language which is kinda useless as far as training data goes.
- westurner 3y ago
  Compared to e.g. religious text translation, I don't know how much subjective analysis there is for UDHR translations. It's pretty cut and dry: e.g. "Equal Protection of Equal Rights" is pretty clear. "About the Universal Declaration of Human Rights Translation Project" https://www.ohchr.org/en/human-rights/universal-declaration/universal-declaration-human-rights/about-universal-declaration-human-rights-translation-project https://www.ohchr.org/en/human-rights/universal-declaration/... : > At present, there are 555 different translations available in HTML and/or PDF format. E.g. Buddhist scriptures are also multiply translated; probably with more coverage in East Asian languages. Thomas Jefferson, who wrote the US Declaration of Independence, had read into Transcendental Buddhism and FWIU is thus significantly responsible for the religious (and nonreligious) freedom We appreciate in the United States today.