3 ms·
Some hackers have been trying to reuse Google's offline speech recognition models within other software toolkits, https://hackaday.io/project/164399-android-off
by walterbell 6y ago
Some hackers have been trying to reuse Google's offline speech recognition models within other software toolkits, https://hackaday.io/project/164399-android-offline-speech-recognition-natively-on-pc https://hackaday.io/project/164399-android-offline-speech-re...
> Especially the offline part is very appealing to me, as it should to any privacy conscious mind. Unfortunately this speech recognizer is only available to Pixel owners at this time. Since GBoard uses TensorFlow Lite, and the blog post is also mentioning the use of this library, I was wondering if I could get my hands on the model, and import it in my own projects, maybe even using LWTNN.
Recent (May 2020) news suggests that these models may be coming to Chromium, which would make them widely accessible for offline transcription and dictation, e.g. WebRTC or video captions, https://hackaday.io/project/164399-android-offline-speech-recognition-natively-on-pc/log/176945-soda-speech-on-device-api/discussion-144497 https://hackaday.io/project/164399-android-offline-speech-re...
> Google is building speech recognition into Chromium, to bring a feature called Live Caption to the browser. To transcribe videos playing in the browser a new API is slowly being introduced: SODA ... What is especially interesting is that it seems it will be using the same language packs and RNNT models as the Recorder and GBoard apks
In Aug 2019, the Live Transcribe engine was open-sourced, https://github.com/google/live-transcribe-speech-engine https://github.com/google/live-transcribe-speech-engine & https://opensource.googleblog.com/2019/08/bringing-live-transcribes-speech-engine.html https://opensource.googleblog.com/2019/08/bringing-live-tran...
- antpls 6y agoYep, that will be fun. Hopefully we will soon see the same hardware accelerators in laptops than currently existing in smartphones. I bet in the future, neural models will constantly run in background for some tasks.
- noThanksss 6y agoneural models will constantly run in background This doesn't feel like progress to me.
- MrBuddyCasino 6y agoThats not the engine though, its just an API wrapper that enables infinite streams for the 5-minute limited sessions lengths of the Google API.
- walterbell 6y agohttps://github.com/google/live-transcribe-speech-engine/blob/master/README.md https://github.com/google/live-transcribe-speech-engine/blob... > Extensible to offline models Hopefully a future version can work without the cloud API.
- dandare 6y agoLaptops urgently need to have a hardware switch for the microphone. A mobile phone should have one too - but that will never happen. At least the laptop is large enough that one little switch is not a problem (unless you are Apple and even essential peripherals are a problem).
- throwaway77384 6y agoPinephone and Librem 5 have these afaik. Purism laptops do as well, I believe.
- GeekyBear 6y ago>Apple has brought its hardware microphone disconnect security feature to its latest iPads. The microphone disconnect security feature aims to make it far more difficult for hackers to use malware or a malicious app to eavesdrop on a device’s surroundings. The feature was first introduced to Macs by way of Apple’s T2 security chip last year. The security chip ensured that the microphone was physically disconnected from the device when the user shuts their MacBook lid. https://techcrunch.com/2020/04/03/apple-hardware-microphone-disconnect-ipads/ https://techcrunch.com/2020/04/03/apple-hardware-microphone-...
- arvinsim 6y agoAs someone who uses his laptop in clamshell mode most of the time, this was an anti-feature for me. Having to literally lift the lid and MacOS readjusting the display every time I want to have a meeting was frustrating. It got to the point where I just bought a cheap USB microphone just to be done with it. I support having a hardware switch for it so that I can have the choice.
- danielscrubs 6y agoFor me it certainly is a feature. I want the microphone of when turning down the lid. I mean, the microphone is under the lid anyway so you are not doing whoever you are talking to any favours by using it in clamshell mode anyway.
- 6y ago