7 ms·
Coqui, a startup providing open speech tech for everyone
- topicseed 6y agoWhat is open speech tech? Clicked twice (GitHub, website's homepage) and didn't really get much out of it.
- Miraste 6y agoThey have text-to-speech software and speech-to-text software, both of which are open source.
- amelius 6y agoI'm not sure but in any case they have a great collection of papers and talks in that repository.
- totetsu 6y agoBasically building the tools to collect data, and models to let anyone implement voice interfaces in their system without needing to use a closed api.
- andrewfromx 6y agoI think it’s like https://www.descript.com/ https://www.descript.com/
- jsnk 6y agoDescript doens't look like it's open source though.
- andrewfromx 6y agoexactly, that's why this is exciting!
- andrewfromx 6y agoalso like https://www.resemble.ai https://www.resemble.ai I remember using that one awhile ago and thinking this should all be open source
- resoluteteeth 6y agoIn case it helps clarify what this is, I think the reason this is getting posted is because it was discussed earlier as a continuation of Mozilla's TTS work: https://news.ycombinator.com/item?id=26790281 https://news.ycombinator.com/item?id=26790281
- explorigin 6y agoI'm glad to see this. I hope they can get the TTS to sound more conversational and less like a newscaster...that being said...free is nice.
- indigochill 6y agoThe quality is also miles better than the last open source TTS I've heard that wasn't just an Amazon SDK. I'll take newscaster-voice over robot-from-the-early-00's.
- EMM_386 6y agoThe sample links are impressive to me. I don't follow the space closely but they sound conversational. https://soundcloud.com/user-565970875/pocket-article-wavernn-and-tacotron2 https://soundcloud.com/user-565970875/pocket-article-wavernn...
- kdavis 6y agoSome samples of the TTS voice are here[1] [1] https://erogol.github.io/ddc-samples/ https://erogol.github.io/ddc-samples/
- trowngon 6y agoLooks like a fork of Mozilla DeepSpeech by former DeepSpeech developers. What is the relation to the original project?
- basaltbeach 6y agotl;dr: - Mozilla fired the developers and mothballed the project - But wants to keep it around as a museum piece All ongoing development is happening in the fork.
- totetsu 6y agoI was very sad when that happened. There were a lot of language communities organizing their efforts around that project too.
- basaltbeach 6y agoYeah, they really dumped them in it, fortunately the devs are keeping it all going at coqui.ai and are really supportive of any community that got abandoned by Moz.
- caddemon 6y agoNothing to do with the tech, but I love your name! I'm just a tourist in Puerto Rico but I've been a number of times and it always warms my heart to hear the Coqui frogs at night. I even play the recordings at home sometimes if I'm having trouble falling asleep. For anyone that hasn't heard of Coqui frogs before, they are pretty cool animals. Little guys, but a single one can be surprisingly loud and throw its voice pretty effectively. AFAIK they're only really found in Puerto Rico - apparently they can survive in other warm climates but will not sing? Maybe that's an urban legend though. Anyway I know the sound is a little contentious (some hotels get cats to cut down on guest complaints about the Coqui) but I'd recommend checking it out: https://musicofnature.com/coqui-magic-nightscapes/ https://musicofnature.com/coqui-magic-nightscapes/
- icedchai 6y agoUnfortunately, it is a bad name because, right or wrong, it will be easily mispronounced. Cocky AI? Who wants that?
- rhn_mk1 6y agoThe computing industry could get less sensitive and accept that other languages than English exist.
- caddemon 6y agoI agree, but also it's an onomatopoeia, the sound the frogs make actually is "Co-Kee". IIRC the indigenous people in Puerto Rico are the ones that named them a long time ago, but the spelling might have been influenced by the Spanish. Point being that you definitely do not need to speak a non-English language to know how to say the word, you could also just have visited Puerto Rico.
- spoonjim 6y agoKind of an Americentric perspective and also doesn't give people the benefit of the doubt. I'm an American who only speaks English but I think it's an awesome and interesting name compared to most of the lame product names out there.
- rafaeltorres 6y agoJust a note: the colorful frog pictured on the website (https://coqui.ai/ https://coqui.ai/) is not a coqui. Coquis are usually brown and tiny. https://upload.wikimedia.org/wikipedia/commons/6/62/Coqui_Frog_Puerto_Rico.JPG https://upload.wikimedia.org/wikipedia/commons/6/62/Coqui_Fr...
- pabs3 6y agoIs there any information about the training process? Which data was used, which license was that data under and which tools, drivers and hardware was used for the training? Basically I'm wondering if these projects count as libre machine learning projects according to the Debian Deep Learning Team's Machine Learning Policy. https://salsa.debian.org/deeplearning-team/ml-policy https://salsa.debian.org/deeplearning-team/ml-policy
- ftyers 6y agoThey do, the issue is with Tensorflow support iirc and with NVIDIA drivers. So for the English model they use mostly free/open-source data, but some non-free data: - train_files Fisher, LibriSpeech, Switchboard, Common Voice English, and approximately 1700 hours of transcribed WAMU (NPR) radio shows explicitly licensed to use as training corpora. (from https://github.com/coqui-ai/STT/releases/tag/v0.9.3 https://github.com/coqui-ai/STT/releases/tag/v0.9.3) As for the hardware for training... it's basically NVIDIA (you need Tensorflow / CUDA and all that guff). For inference it works realtime on a CPU. I'm preparing pretrained models based on Common Voice data for their STT based on Common Voice data here: https://tepozcatl.omnilingo.cc/manifest.html https://tepozcatl.omnilingo.cc/manifest.html There is plenty of free/open-source voice data out there, just it's a question of reaching for a sick bag and installing NVIDIAs stuff. I don't know if they'd count as free/open-source according to Debian (I'm a Debian user myself), but the team has definitely talked about getting into Debian and would be very open to discussions about it.
- pabs3 6y agoCheck out the ML policy, it sounds like it would currently be classified as a "toxic candy" model due to the non-free data, but it sounds like you could re-train to avoid that. Using CUDA also means it wouldn't be considered legitimately free enough, although folks are working on getting AMD ROCm into Debian. Tensorflow isn't yet in Debian, but there may be folks working on it. Another problem is that Debian doesn't have the hardware for doing training. I'd encourage you to talk to the folks on the debian-ai mailing list and IRC channel to discuss these and other issues. https://lists.debian.org/debian-ai/ https://lists.debian.org/debian-ai/ ircs://irc.oftc.net/debian-ai
- edoceo 6y agohow do I actually use this to turn my speech into text? it seems some docs are 404ing. edit: I found some transcription code: https://github.com/WebThingsIO/voice-addon https://github.com/WebThingsIO/voice-addon DeepSpeech based but close, workable.
- ftyers 6y agoThere is a lot of example code here: https://github.com/coqui-ai/STT-examples https://github.com/coqui-ai/STT-examples If you have any more specific requirements then we can point you in the right direction. Or just join us on Matrix: https://app.element.io/#/room/#coqui-ai_STT:gitter.im https://app.element.io/#/room/#coqui-ai_STT:gitter.im :)
- edoceo 6y agoI want to yell at some webpage that is reading my mobile's mic and have it become text in a <textarea>. And I don't want the company that must not be named to know what I said.
- ftyers 6y agoYou might want something like LocalSTT if it's on mobile: https://github.com/ccoreilly/LocalSTT https://github.com/ccoreilly/LocalSTT Otherwise this code does streaming on a websocket: https://github.com/coqui-ai/STT-examples/tree/r0.9/web_microphone_websocket https://github.com/coqui-ai/STT-examples/tree/r0.9/web_micro...
- edoceo 6y agoyep, just found those I'm looking forward to bothering you on the Matrix ;)
- Rebelgecko 6y agoThis seems neat, but I wish they had more examples of how to use it as a library. Most of their tutorials seem focused on training new models
- kdavis 6y agoThere is a repository with STT examples[1]. Is what you're looking for there? [1] https://github.com/coqui-ai/STT-examples https://github.com/coqui-ai/STT-examples
- Rebelgecko 6y agoIf I'm parsing the acronyms right, that's speech-to-text and I was hoping to try out their Text-to-Speech
- ftyers 6y agoThere is another article about the TTS: https://news.ycombinator.com/item?id=26790951 https://news.ycombinator.com/item?id=26790951
- rytill 6y agoHow does this startup plan to make money? Services?
- throwaway99x99 6y agoWow, that soundcloud sample is amazing. I wonder how long it took to produce it or if it could be produced in real time?
- ftyers 6y agoIirc it is realtime, but check out the Matrix channel: https://app.element.io/#/room/#coqui-ai_TTS:gitter.im https://app.element.io/#/room/#coqui-ai_TTS:gitter.im
- pabs3 6y agoIt would be awesome if this could be integrated into GNOME, KDE and the other open desktops as an accessibility feature.
- barnaclejive 6y agoCocky? Might want to consider a rename before you run into the Coq situation.
- yassine-ajaaoun 6y agoI compared WER of Coqui with Vosk https://github.com/alphacep/vosk-api https://github.com/alphacep/vosk-api. Unfortunately WER of Coqui is much on the lower side. See for details https://github.com/coqui-ai/STT/discussions/1853 https://github.com/coqui-ai/STT/discussions/1853