4 ms·
Whats the point when they killed DeepSpeech in exchange for adapting closed Nvidia thing? https://venturebeat.com/2021/04/12/mozilla-winds-down-deepspeech-deve
by rasz 5y ago
Whats the point when they killed DeepSpeech in exchange for adapting closed Nvidia thing?
https://venturebeat.com/2021/04/12/mozilla-winds-down-deepspeech-development-announces-grant-program/ https://venturebeat.com/2021/04/12/mozilla-winds-down-deepsp...
https://blog.mozilla.org/en/mozilla/mozilla-partners-with-nvidia-to-democratize-and-diversify-voice-technology/ https://blog.mozilla.org/en/mozilla/mozilla-partners-with-nv...
$1.5mil for shutting down open source initiative, almost half of CEO salary right there.
- moralestapia 5y agoLol, these guys sell themselves for peanuts.
- jononor 5y agoWhat closed NVidia thing did they adopt? I don't see any evidence of that here.
- rasz 5y agoIm sure they signed on adopting "something", otherwise it would be receiving $1.5 million grant for closing open source initiative. $3 million a year lawyer wouldn never be this blatant.
- option 5y agohttps://github.com/NVIDIA/NeMo https://github.com/NVIDIA/NeMo which is open source, Pytorch based and regularly publishes new models and checkpoints.
- Seirdy 5y agoThe source code is under a FLOSS license, but it only works on Nvidia GPUs and uses proprietary Nvidia-specific technologies like CUDA. It's significantly closer to "nonfree" on the free-nonfree spectrum than it should be, and is another example of the difference between the guiding philosophies behind "free software" and "open source"
- yorwba 5y agoCan't you run it on CPU? And looking at the code, it seems like they're using Numba to JIT their CUDA kernels, so I guess someone could come along and provide a compatibility shim to make the kernels run on a non-CUDA accelerator?
- stegrot 5y agoDeepspeech is still alive in a way, the team founded the company coqui.ai after the Mozilla layoffs and they keep everything open source.
- mazoza 5y agoI know the old speech team continues as Coqui https://github.com/coqui-ai/ https://github.com/coqui-ai/
- tmalsburg2 5y agoAbout their TTS system: "These models provide speech synthesis with ~0.12 real-time factor on a GPU and ~1.02 on a CPU." The quality of the samples is really impressive but, wow, but isn't this computationally too expensive for many applications?
- nyanpasu64 5y ago>If, for example, it takes 8 hours of computation time to process a recording of duration 2 hours, the real time factor is 4. When the real time factor is 1, the processing is done in real time. It is a hardware-dependent value. I think real-time factors smaller than 1 are faster than real-time (not slower) and use less than 100% of a resource's computational power to keep up.
- tmalsburg2 5y agoNot sure what you're quoting because I didn't write that, but > I think real-time factors smaller than 1 are faster than real-time (not slower) and use less than 100% of a resource's computational power to keep up. Sure, but who has the necessary GPUs installed? And on CPUs it will apparently take longer to generate speech than the duration of that speech. Unusable for many UIs and it will also drain the batteries of any portable device.
- jpetso 5y agoYou're not wrong, but with so many chips incorporating some sort of dedicated "AI" or "tensor" functionality, perhaps the issue will resolve itself for most portable devices in a few years. Plus there's always the option of optimizing a little more and/or abusing other available hardware such as DSP chips to get the real time factor down. Anything over 1 isn't great, but it's not a bad start.
- jononor 5y agoOpen-source speech recognition is doing pretty good with projects such as VOSK, Athena, ESPNet and SpeechBrain. These days models are the easy part of ML, and data is the hard one. So for Mozilla to focus on Common Voice over DeepSpeech seems reasonable.
- tkinom 5y agoWould one use the youtube as training date? Especially for the videos with Close Caption.... As simple as extracting the Audio and CC text?
- soapdog 5y agoYou can't really do it because of licensing reasons. One cool thing Common Voice brings to the table, besides all the fantastic data, is the licensing.
- anonymfus 5y agoYouTube still allows uploaders to mark their videos as CC BY 3.0 licensed, and it's still possible to check that via YouTube's API. (See https://support.google.com/youtube/answer/2797468 https://support.google.com/youtube/answer/2797468 and the part about status.license here: https://developers.google.com/youtube/v3/docs/videos https://developers.google.com/youtube/v3/docs/videos)
- ma2rten 5y agoAre you sure it's not fair use? I believe most legal experts agree that language models such as GPT-3 are not violating copyright due to fair use.
- amelius 5y agoSource?
- humanistbot 5y agoFair use is whatever a judge and/or a jury says it is.
- hkt 5y agoHaving an open corpus means that researchers building the next thing in voice research - which may or may not follow DeepSpeech - have something to work with. This is enormously important and their change of direction lets a thousand flowers bloom. Meanwhile, their partnership with Nvidia provides a fertile ground to prove the value of the open corpus in action. Nvidia get access to Mozilla's (presumably superior) ability to build said corpus, while Mozilla lay the foundations for others to contribute work in the open. It is a great example of comparative advantage, and a win win choice, IMO.
- rasz 5y agoSo in other words we provide data for free to Mozilla, and Mozilla turns around and sells it for millions to Nvidia to fund ... not open source, they killed that so umm ee, to fund ceo salary?
- nmstoker 5y agoYou seem to imply that Nvidia are paying for data that is freely available. Anyone can use the Common Voice data within the terms of the license and NVIDIA contributing towards the continued gathering of data (that will continue to be made publicly available) won't change that. It's a huge shame that Mozilla didn't continue the DeepSpeech project but Coqui is taking on the mantle there and there are plenty of others working on open source solutions too, all whilst the existence of CV will make a big difference to research, in the academic, commercial and open source spheres.
- robbedpeter 5y agoCoqui is phenomenally good and well done, so this new data should lower the barrier to entry for the represented languages.
- danShumway 5y ago> and sells it If that was true that would be a profoundly bad purchase for NVidia since the data is already freely licensed and available for anyone to use at no cost. This is like saying that Epic "bought" Blender when they gave it a development grant, or that Google contributing patches to upstream Linux means they own it now. Mozilla didn't give NVidia any kind of special license, when NVidia contributes data to Common Voice they're doing so under Common Voice's license, not their own. We want to encourage more companies to treat software and training data as a public commons that is collectively maintained, this is a good thing.