4 ms·

This is a nicely designed interface. Well done, Mozilla. Validating sentences is quite fun, listening to different accents from around the world. Try it out if

by ipsum2 8y ago

This is a nicely designed interface. Well done, Mozilla. Validating sentences is quite fun, listening to different accents from around the world. Try it out if you haven't already: https://voice.mozilla.org/en/listen https://voice.mozilla.org/en/listen It's awesome that the dataset is offered with a CC-0 license: https://voice.mozilla.org/en/data https://voice.mozilla.org/en/data, does anyone know if it includes the answers from the survey? I have a limited bandwidth internet, so I haven't checked it out yet. In particular, I'm wondering if there's user data on whether they picked yes or no, to implement "troll detection" - people who click one option all the time. Trolling of crowdsourced data isn't unheard of. (NSFW language: https://www.reddit.com/r/pics/comments/cygfx/4chan_is_using_googles_captcha_technology_to_get/ https://www.reddit.com/r/pics/comments/cygfx/4chan_is_using_...)

userbinator 8y ago
Trolling of crowdsourced data isn't unheard of. ...in that case it was specifically done in retaliation to Google trying to get free mental labour from ReCAPTCHA users in return for being able to post to 4chan. Quite a different situation.
- deleted 8y ago
  [deleted]
archgoon 8y ago
> It's awesome that the dataset is offered with a CC-0 license: https://voice.mozilla.org/en/data https://voice.mozilla.org/en/data, does anyone know if it includes the answers from the survey? I'm downloading it now, I'll have an answer in a half hour. Does anyone know if there is a torrent for it?
- archgoon 8y ago
  Well, download took longer than expected :). Anyhow, here's a sample from the csv file: filename,text,up_votes,down_votes,age,gender,accent,duration cv-valid-test/sample-001224.mp3,but i felt miserable watching him wither away like a shriveled dandelion,1,0,thirties,male,england, Not sure how some of these are being populated, but yeah; there's several additional folders including invalid mp3, a splintered train set (not sure how it was selected) and a test set folder. Here's the README.txt. Looks cool! Have happy hacky fun! :) https://gist.github.com/cwgreene/f7f4df4ddcd9da017b9f4694b3f46d51 https://gist.github.com/cwgreene/f7f4df4ddcd9da017b9f4694b3f... Interestingly; many of the 'invalid' mp3's are actually (mostly) correct. Listening to them is interesting to guess as to why they were downvoted.
  - punchingwater 8y ago
    We also keep the README in the repo: https://github.com/mozilla/voice-web/blob/master/docs/corpus_readme.txt https://github.com/mozilla/voice-web/blob/master/docs/corpus...
    - archgoon 8y ago
      Thanks! Couldn't find the source of the Readme in the zipfile. Can you talk about what the update process for this file is? How often is it updated? Is there a way to just download the new files? Is there a tarball script for this in the repo somewhere? I see that you have instructions for s3, are the files actually backed in s3? Is it possible to download them with s3 (possibly using requester pays)?
      - punchingwater 8y ago
        We have no plans to allow users to download the "raw" data from s3 (ie. before we perform the train/dev/test split). But we want to eventually build some tools to automate this. See here for some background: https://discourse.mozilla.org/t/the-mozilla-guarantee-publishing-multi-language-voice-data/29649 https://discourse.mozilla.org/t/the-mozilla-guarantee-publis...
- Rodd45 8y ago
  Can't wait to try it either.
punchingwater 8y ago
We used some of the research around Mechanical Turk to find best practices for limiting trolling (e.g. [1]). Our approach thus far has been the two-thirds rule: if two out of three people say the clip is good/bad, we trust that. Also note, that we have seen remarkable low trolling numbers, and that most of the invalid are pronunciation mistakes or saying the wrong word. 1.) https://groups.csail.mit.edu/sls/publications/2010/McGraw_LREC2010.pdf https://groups.csail.mit.edu/sls/publications/2010/McGraw_LR...

by ipsum2 8y ago

userbinator 8y ago

Trolling of crowdsourced data isn't unheard of. ...in that case it was specifically done in retaliation to Google trying to get free mental labour from ReCAPTCHA users in return for being able to post to 4chan. Quite a different situation.

deleted 8y ago
[deleted]

archgoon 8y ago

> It's awesome that the dataset is offered with a CC-0 license: https://voice.mozilla.org/en/data https://voice.mozilla.org/en/data, does anyone know if it includes the answers from the survey? I'm downloading it now, I'll have an answer in a half hour. Does anyone know if there is a torrent for it?

archgoon 8y ago
Well, download took longer than expected :). Anyhow, here's a sample from the csv file: filename,text,up_votes,down_votes,age,gender,accent,duration cv-valid-test/sample-001224.mp3,but i felt miserable watching him wither away like a shriveled dandelion,1,0,thirties,male,england, Not sure how some of these are being populated, but yeah; there's several additional folders including invalid mp3, a splintered train set (not sure how it was selected) and a test set folder. Here's the README.txt. Looks cool! Have happy hacky fun! :) https://gist.github.com/cwgreene/f7f4df4ddcd9da017b9f4694b3f46d51 https://gist.github.com/cwgreene/f7f4df4ddcd9da017b9f4694b3f... Interestingly; many of the 'invalid' mp3's are actually (mostly) correct. Listening to them is interesting to guess as to why they were downvoted.
- punchingwater 8y ago
  We also keep the README in the repo: https://github.com/mozilla/voice-web/blob/master/docs/corpus_readme.txt https://github.com/mozilla/voice-web/blob/master/docs/corpus...
  - archgoon 8y ago
    Thanks! Couldn't find the source of the Readme in the zipfile. Can you talk about what the update process for this file is? How often is it updated? Is there a way to just download the new files? Is there a tarball script for this in the repo somewhere? I see that you have instructions for s3, are the files actually backed in s3? Is it possible to download them with s3 (possibly using requester pays)?
    - punchingwater 8y ago
      We have no plans to allow users to download the "raw" data from s3 (ie. before we perform the train/dev/test split). But we want to eventually build some tools to automate this. See here for some background: https://discourse.mozilla.org/t/the-mozilla-guarantee-publishing-multi-language-voice-data/29649 https://discourse.mozilla.org/t/the-mozilla-guarantee-publis...
Rodd45 8y ago
Can't wait to try it either.

punchingwater 8y ago

We used some of the research around Mechanical Turk to find best practices for limiting trolling (e.g. [1]). Our approach thus far has been the two-thirds rule: if two out of three people say the clip is good/bad, we trust that. Also note, that we have seen remarkable low trolling numbers, and that most of the invalid are pronunciation mistakes or saying the wrong word. 1.) https://groups.csail.mit.edu/sls/publications/2010/McGraw_LREC2010.pdf https://groups.csail.mit.edu/sls/publications/2010/McGraw_LR...