5 ms·
Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled. Massive mountains of data tends to be incompatible
by londons_explore 6y ago
Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled.
Massive mountains of data tends to be incompatible with opensource projects. Even Mozilla collecting user statistics is pretty controversial. Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!!
- marcodiego 6y agoReally complicated question, but considering the free world got wikipedia and openstreetmaps, I'd bet we'll find a way.
- JadeNB 6y ago> Really complicated question, but considering the free world got wikipedia and openstreetmaps, I'd bet we'll find a way. Both of those involve entering data about external things. Asking people to share their own data is another thing entirely—I suspect most people, me included, are much more suspicious about that.
- posmonerd 6y agoNot an expert on any of this, but wouldn’t already published content (public or proprietary) such as Youtube videos, audiobooks, tv interviews, movies, tv programs, radio programs, podcasts, etc. be useful and exempt from privacy concerns? Do user collected clips have soemthing so special to the point that it’s critical to collect them?
- eliaspro 6y agoMovies etc would need to be transcribed accurately to be useful for training and even then just provide a single sample for the specific item.
- sodality2 6y ago> Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!! They do, and it's working! https://commonvoice.mozilla.org/en https://commonvoice.mozilla.org/en
- londons_explore 6y agoExcept they have 12k hours of audio, when really they could do with 12B hours of audio...
- sodality2 6y agoGood point. I'm doing my part to contribute to it, though, not much else I can do!
- woodson 6y agoThen you need a lot of people that listen to those 12B hours of audio, and multiple listeners agree for each chunk of audio that what is spoken corresponds to the transcript.
- londons_explore 6y agoLots of machine learning systems can use unsupervised and semi-supervised learning. Then nobody has to listen to and annotate all that audio.
- woodson 6y agoYes, but then you don't need Mozilla collecting read speech samples. You can just scrape any audio out there, run speech activity detection, and there you go.
- totetsu 6y agoDidn't Moz fire all the people who worked on this, and they have started their own project now?
- timvisee 6y agoAnother problem is that the models tend to get very very large for what I've seen. A gigabyte to 10s of gigabyes is an undesirable requirement on your local machine.
- kelnos 6y agoNot sure about others, but DeepSpeech also distributes a "lite" model that's much smaller and suitable for mobile devices. Not sure how its accuracy compares to the full model though.
- londons_explore 6y agoWith insane amounts of computation, making models much smaller while having minimal impacts on performance is possible.
- GekkePrutser 6y agoWell speech recognition for personal use doesn't have to recognise everyone. In fact it's a feature, not a bug if it recognises only me as the user.