10 ms·
Mozilla's Speech-to-Text Engine Is at Risk Following Layoffs
- nshm 6y agoNot a big problem given so many alternatives around like E.g. some very active projects are: * Kaldi (https://github.com/kaldi-asr/kaldi/ https://github.com/kaldi-asr/kaldi/) obviously, probably the most famous one, and most mature one. For standard hybrid NN-HMM models and also all their more recent lattice-free MMI (LF-MMI) models / training procedure. This is also heavily used in industry (not just research). * ESPnet (https://github.com/espnet/espnet https://github.com/espnet/espnet), for all kind of end-to-end models, like CTC, attention-based encoder-decoder (including Transformer), and transducer models. * Espresso (https://github.com/freewym/espresso https://github.com/freewym/espresso). * Google Lingvo (https://github.com/tensorflow/lingvo https://github.com/tensorflow/lingvo). This is the open source release of Googles internal ASR system, and used by Google in production (their internal version of it, which is not too much different). * NVIDIA OpenSeq2Seq (https://github.com/NVIDIA/OpenSeq2Seq https://github.com/NVIDIA/OpenSeq2Seq). * Facebook Fairseq (https://github.com/pytorch/fairseq https://github.com/pytorch/fairseq). Attention-based encoder-decoder models mostly. * Facebook wav2letter (https://github.com/facebookresearch/wav2letter https://github.com/facebookresearch/wav2letter). ASG model/training. * Vosk (https://github.com/alphacep/vosk-api https://github.com/alphacep/vosk-api). Offline lightweight speech recognition API with support for 10 languages. And there are much more.
- foolzcrow 6y agoMozilla supports censorship and banning for wrong-think. So I don't care what happens to them.
- krzepah 6y agoCan you please source at least when you state such things on HN ? this is not reddit
- macspoofing 6y agoProbably alluding to Eich, a competent executive with a technical background (because don't we have enough lawyers in executive positions?), having been pushed out for his private beliefs. 6 years later, rightly or wrongly, they are judged for this decision. There is value in organizations staying politically neutral, especially if the are trying to build a broad coalition to further other goals (such as internet privacy and open-standards - as Mozilla is trying to do).
- AtticHacker 6y agoMaybe related to the removal of dissenter, at least that's one thing https://discourse.mozilla.org/t/the-removal-of-the-dissenter-extention/38140/88 https://discourse.mozilla.org/t/the-removal-of-the-dissenter...
- suby 6y agoSemi-related, but does anyone know if Firefox Send is on the chopping block? They took it down before the layoffs due to security concerns, and now I'm worried it won't be coming back online. Every alternative I've been able to find has been either poor quality or too shady for me to ever actually want to use.
- DHPersonal 6y agoI just started renting my own cloud storage space for moments like this.
- Mandatum 6y agoNot given priority right now - it's getting abused by malware authors. Confirmed via Mozilla IRC. You can set it up yourself really easily (got it running locally on Mac in 5 mins), throw an auth'd gateway in front of it to keep it away from bad actors: https://github.com/mozilla/send https://github.com/mozilla/send
- gruez 6y ago>Every alternative I've been able to find has been either poor quality or too shady for me to ever actually want to use. have you tried https://catbox.moe/ https://catbox.moe/ (or others https://archiveteam.org/index.php?title=Pomf.se/Clones https://archiveteam.org/index.php?title=Pomf.se/Clones)? Not sure what you mean by "shady", but most of them provide a direct download without any interstitials.
- sbierwagen 6y agoI've mostly heard of people using Magic Wormhole for this https://github.com/warner/magic-wormhole https://github.com/warner/magic-wormhole Never used it myself
- Tanath 6y agoSeems unlikely. The layoffs happened before they got a new deal: https://www.theverge.com/2020/8/15/21370020/mozilla-google-firefox-search-engine-browser https://www.theverge.com/2020/8/15/21370020/mozilla-google-f... Now they can bring people back.
- fooker 6y ago>Now they can bring people back. Or they can increase executive compensation. How far in advance do you think these deals are decided before public announcement?
- infinityplus1 6y agoAnyone who left isn't coming back. They would now go for better opportunities.
- macspoofing 6y agoYou think they didn't know this deal was going to be signed before they announced their layoffs?
- contravariant 6y agoNow I'm not the most knowledgeable when it comes to managing companies so I can't be sure if that is the right move or not. However surely any management that announces massive lay-offs to then turn around and hire those same people back a few weeks later would have to be deemed blatantly incompetent (if not malicious)?
- jjcon 6y agoI’m glad to see the healthy skepticism towards Mozilla lately, they have long been a sacred cow in tech. Just because a company’s mission is positive or aligns with ones values does not mean the company itself is good or is actually carrying that mission out.
- fxtentacle 6y agoAgree, but you seem to be turning downvoted-transparent. I am also always surprised that Mozilla receives so much praise for its technology stack, when their core source code for Firefox and Thunderbird is such a buggy pain to work with. I understand that they inherited a legacy codebase, but I'm not sure that playing catch-up with Google on (in my opinion) useless features like WebUSB was good technical management. In fact, I would argue that letting technical debt accumulate to the point where you need to rewrite large parts in a completely different language and deprecate technologies still in use (e.g. XUL) is more like an admission of failed technical leadership. So I am honestly surprised that Mozilla is cutting projects and firing developers, yet nobody seems to take action to reduce the overhead of their apparently incapable management.
- bestouff 6y agoMaybe I'm unlucky, but any company I worked in has that legacy codebase which kind-of works, has bugs, and that nobody wants to refactor - and I don't blame them, refactoring code which had years of debugging is not always a good idea if you don't have unlimited money.
- fxtentacle 6y agoI also wouldn't blame them for not fixing old bugs if they had a shortage of developers. But letting critical security bugs go un-patched, so that your team can work on obscure shiny new stuff instead, that looks like wrong priorities to me. Nobody would switch to Firefox for WebUSB, which is why I chose it as the example. There's only crickets on Twitter: https://twitter.com/hashtag/webusb https://twitter.com/hashtag/webusb Instead, people switch to Firefox for privacy, safety and reliability. Mozilla should prioritize those areas highly. But in the past, they haven't. Instead, they burned a lot of money on acquiring 3rd party services that many Firefox users see as nothing more than unnecessary bloat. Like $30 mio for Pocket. That's why I point the blame at their management, not their code base or developers. And just FYI, I'm pretty sure I could hire a world-class team and build an excellent Speech-to-Text Engine just from Mozilla's management budget for a single year. Because AFAIK, their (in my opinion incapable) management pocketed $80 mio in 2018. https://assets.mozilla.net/annualreport/2018/mozilla-fdn-2018-short-form-final-0926.pdf https://assets.mozilla.net/annualreport/2018/mozilla-fdn-201...
- jacquesm 6y agoDon't put a lawyer in charge of a tech company.
- fxtentacle 6y ago"But I think most would also agree that if all corporate lawyers, bank lobbyists, or marketing gurus were to similarly vanish in a puff of smoke, the world would be at least a little bit more bearable." I remember just yesterday there was a great article on HN that discussed bullshit jobs and counted corporate lawyers towards the "goons". The rationale was that if nobody has them, nobody else needs them. https://www.businessinsider.com.au/bullshit-jobs-australia-2018-7 https://www.businessinsider.com.au/bullshit-jobs-australia-2...
- HPsquared 6y agoIt's kind of like the military in that sense. Anything 'PvP' falls in that category.
- AlphaSite 6y agoWho exists to enforce the rules? Contracts? Etc. I feel like this sounds great on the surface, but is quite flawed.
- zaptrem 6y agoAgreed. Lawyers (and by extension, the legal system) must exist to ensure order and keep the system fair for as many people as possible. They don’t always achieve that goal, but removing them entirely would make things 100x worse. My favorite example is the ACLU.
- craigsmansion 6y agoYou can put them in charge of a country, as long as they are effective. "Hate the game, not the player", might be appropriate here, but even in corporate games players can simply be so ineffective that they should be replaced by someone who can actually play the game.
- joecool1029 6y agohmm, Firefox Voice was supposed to eventually use the speech-to-text engine that's now under threat but instead currently uses Google's engine? Can't imagine priorities like this came up in their recent negotiations.
- est31 6y agohttps://news.ycombinator.com/item?id=24245683 https://news.ycombinator.com/item?id=24245683
- zo1 6y agoAm I the only one trying to figure out why Mozilla even has a "speech-to-text" team?
- stevenjohns 6y agoYou've actually touched on something very important here: Mozilla seems to be getting its fingers into more than it can handle. It wants to do everything but ends up doing a lot of things fairly poorly. I switched away from Firefox to Brave yesterday. Became tired of how Firefox threads would consume 99% of my CPU endlessly until they're manually killed. This happened about four or five times a day, I'd only notice when performance of everything else tanks. I wish Mozilla would direct more resources towards Firefox than Lockwise and all the other half-baked junk they're spending developer time on.
- dboreham 6y agoIn my experience Chromium does this too (busy spinning threads).
- johannes1234321 6y agoThey want to build technologies which bring access for everybody. There is a huge population of people who can't type easily and where speech is an important alternative. Having all input running through an ad company (Google) or requiring to buy premium products (Apple) isn't good for an inclusive society valuing privacy. Quoting their mission statement: "Our mission is to ensure the Internet is a global public resource, open and accessible to all. An Internet that truly puts people first, where individuals can shape their own experience and are empowered, safe and independent." https://www.mozilla.org/en-US/mission/ https://www.mozilla.org/en-US/mission/ However Mozilla seems like it did too many wrong bets and didn't execute well (see also FirefoxOS)
- suby 6y agoThe world needs a state of the art and easy to integrate library for providing speech to text so that we don't have to rely on sending all of our voice data to the big tech giants. I imagine this was the motivation behind it. That being said, I think the current open source options are actually okay and constantly getting better. They're certainly a lot better today than they were 3 years ago.
- HackedBunny 6y agoMy quick test of DeepSpeech, as posted on Facebook back in April: -- I just ran a speech-to-text converter on a very clear clip of former Doctor Who actor Tom Baker talking in an interview. The DeepSpeech converter uses the very latest AI deep-learning advancements to 'listen' to the audio and output the spoken words as text. After 3 long minutes of running it on a 30-second clip, it printed out its interpretation: "hooloomooloo how booboorowie i have a honeymoon"
- fxtentacle 6y agoWhen I tried it out with English and German phone recordings, it was working competitively. I would have ranked it better than Amazon but worse than Google. Did you maybe not convert your WAV to the correct sampling rate?
- donw 6y agoI didn’t know Tom Baker was Welsh.
- twoslide 6y agoIt's supposed to work on sentence long audio (4 - 5 seconds), they suggest chunking your audio first: https://discourse.mozilla.org/t/longer-audio-files-with-deep-speech/22784 https://discourse.mozilla.org/t/longer-audio-files-with-deep...
- magicalhippo 6y agoAlso there's essentially two parts to this, the neural net is used for speech-to-characters, and then a language model is used to convert the character stream to words. I found that the language model they supplied was trained data that did not contain the words I needed, and got significantly improved results when making my own language model using the kenlm[1] tools. [1]: https://kheafield.com/code/kenlm/ https://kheafield.com/code/kenlm/
- zaptrem 6y agoWould it be possible to substitute this for GPT2/BERT? Or is that a different type of language model? Can the pre-trained language model be fine-tuned? I’m using DeepSpeech to transcribe long-form lecture audio, and have just assumed there would be a massive improvement once they noise-harden the models with 1.0.
- dgellow 6y agoIt's always sad to see people at the risk of losing their job or the project they are working on. That being said, this Speech to Text engine always seemed to be more a distraction than anything else. There is of course a lot of pessimism at the moment toward Mozilla, and I subscribe to it for the most part, but if the recent changes and upcoming changes result in more focused projects and efforts that wouldn't necessarily be a bad thing.
- macspoofing 6y agoI don't understand what Mozilla is. They re-upped the Google deal to the tune of $400-450million/year for the next 3 years, so their revenue is secure. That's great. I can also understand that it makes sense to cut some side-projects that are probably a distraction (and this one may very well fit that category). But if you cut funding to things like MDN, Servo/Rust and move away from Firefox as a core focus (the thing that just brought you another $1.2 billion) .. what the heck is Mozilla now?
- BiteCode_dev 6y agoWait, move away from firefox as a core focus ?
- macspoofing 6y agoYeah. From https://blog.mozilla.org/blog/2020/08/11/changing-world-changing-mozilla/ https://blog.mozilla.org/blog/2020/08/11/changing-world-chan... They list their 5 areas to focus on .. and Firefox isn't mentioned by name anywhere. For example: "New focus on product. Mozilla must be a world-class, modern, multi-product internet organization. That means diverse, representative, focused on people outside of our walls, solving problems, building new products, engaging with users and doing the magic of mixing tech with our values" (emphasis mine)
- Krasnol 6y agoThe second sentence of the article you linked is: > Mozilla exists so the internet can help the world collectively meet the range of challenges a moment like this presents. Firefox is a part of this. They follow up on this by saying that they need to go BEYOND the browser but it doesn't mean that they want to drop it. But well...you never know with that hollow techmarketing talk...
- macspoofing 6y ago>but it doesn't mean that they want to drop it. I wasn't trying to suggest there was no mention of Firefox in their roadmap blog - though it is telling that the Firefox mention you pointed to is in context of an argument for developing non-Firefox products. Nor was I arguing that they will drop Firefox. Even if they wanted to, they wouldn't be able to because Firefox is their sole revenue driver and the only thing that gives them a seat at the table for developing open-standards. To me the telling part was when they listed their five areas of focus, and Firefox was not one of them.
- callamdelaney 6y agoThis (text to speech) breaks pulse audio on my machine every time I enable reader view. Even if I'm not using text to speech or listening to anything else, I'll get a whiny noise until I restart pulse.
- throwme45353464 6y agoThe browser does have this effect on Linux systems with pulseaudio. You will hear lots of static in your speakers, and after that the audio will be distorted until you restart pulseaudio. What I cannot confirm is the relation of this to the speech-to-text engine. Reader mode most likely utilizes text to speech.
- aokiji 6y agoThis is probably the symptom of the traditional open-source extermination plays. Provide huge financing but require them to dilute attention and core focus across seemingly positive projects. The main core, security, privacy and empowering users goes down the drain. That is why instead of focusing on that, we get pointless UI changes for mobile Firefox versions.