4 ms·

I guess Mozilla's own speech to text (https://github.com/mozilla/DeepSpeech https://github.com/mozilla/DeepSpeech) isn't good enough, so they have to use Google

by ipsum2 6y ago

I guess Mozilla's own speech to text (https://github.com/mozilla/DeepSpeech https://github.com/mozilla/DeepSpeech) isn't good enough, so they have to use Google's?

kevingadd 6y ago
Presumably the reason they want you to opt-in to saving recordings is so they can train DeepSpeech.
- setzer22 6y ago
  But DeepSpeech has already been trained with millions of data samples! I'd feel way better about it if they went for a slightly worse DeepSpeech based implementation, but kept it working in the free software spirit they have been known about for many years. Also, for desktop devices inference on DeepSpeech is cheap enough, so they could even go the extra mile and work on some Wasm magic to get offline recognition. That's the kind of work I'd expect from Mozilla! Not wiring up your data collection to the Google Cloud APIs and call it a day! I'm genuinely disappointed with them...
  - posguy 6y ago
    The audio Mozilla DeepSpeech is trained on is not very large (about 2000 hours) or diverse (eg: mostly native American English Male voices) and has very little ability to handle noise, accents or other errata. Comparatively, Baidu had 5000 hours of English to train their versions of DeepSpeech and DeepSpeech2 on, and thus had better results years ago. Google, Microsoft, IBM and other companies have users providing more audio samples on a daily basis, enabling much better quality speech to text. Mozilla's Common Voice project only has 1492hrs of validated English currently: https://commonvoice.mozilla.org/en/datasets https://commonvoice.mozilla.org/en/datasets
- bananaface 6y ago
  DeepSpeech is a lot less accurate and much slower than Facebook's FOSS offering, wav2letter, on equivalent data. If they want something competetive they'll need to drop DeepSpeech, or overhaul it. Common Voice is where the value is. Like, there's nothing stopping firefox from just using wav2letter. It's BSD-licensed. https://github.com/facebookresearch/wav2letter https://github.com/facebookresearch/wav2letter

by ipsum2 6y ago

I guess Mozilla's own speech to text (https://github.com/mozilla/DeepSpeech https://github.com/mozilla/DeepSpeech) isn't good enough, so they have to use Google's?

kevingadd 6y ago

Presumably the reason they want you to opt-in to saving recordings is so they can train DeepSpeech.

setzer22 6y ago
But DeepSpeech has already been trained with millions of data samples! I'd feel way better about it if they went for a slightly worse DeepSpeech based implementation, but kept it working in the free software spirit they have been known about for many years. Also, for desktop devices inference on DeepSpeech is cheap enough, so they could even go the extra mile and work on some Wasm magic to get offline recognition. That's the kind of work I'd expect from Mozilla! Not wiring up your data collection to the Google Cloud APIs and call it a day! I'm genuinely disappointed with them...
- posguy 6y ago
  The audio Mozilla DeepSpeech is trained on is not very large (about 2000 hours) or diverse (eg: mostly native American English Male voices) and has very little ability to handle noise, accents or other errata. Comparatively, Baidu had 5000 hours of English to train their versions of DeepSpeech and DeepSpeech2 on, and thus had better results years ago. Google, Microsoft, IBM and other companies have users providing more audio samples on a daily basis, enabling much better quality speech to text. Mozilla's Common Voice project only has 1492hrs of validated English currently: https://commonvoice.mozilla.org/en/datasets https://commonvoice.mozilla.org/en/datasets
bananaface 6y ago
DeepSpeech is a lot less accurate and much slower than Facebook's FOSS offering, wav2letter, on equivalent data. If they want something competetive they'll need to drop DeepSpeech, or overhaul it. Common Voice is where the value is. Like, there's nothing stopping firefox from just using wav2letter. It's BSD-licensed. https://github.com/facebookresearch/wav2letter https://github.com/facebookresearch/wav2letter