2 ms·
Very nice! Would you be interesting in integrating with my project Willow[0]? Willow supports Home Assistant, OpenHAB, and generic REST+MQTT endpoints today.
by kkielhofner 3y ago
Very nice!
Would you be interesting in integrating with my project Willow[0]?
Willow supports Home Assistant, OpenHAB, and generic REST+MQTT endpoints today. With Home Assistant and OpenHAB we benefit from their specific API support for providing speech to text output and processing through things like the HA Assist Pipelines[1].
From our standpoint we handle wake word, VAD+AEC+BSS, STT, TTS, user feedback, etc. All we really do is send the speech transcript to the Willow command endpoint (like HA) and speak+display the execution result. Other than all of the wild speech stuff and our obsession with speed and accuracy Willow is really quite "dumb" - think of it as a voice terminal.
OpenHAB has something similar but it's significantly more limited.
[0] - https://heywillow.io https://heywillow.io
[1] - https://developers.home-assistant.io/docs/voice/pipelines/ https://developers.home-assistant.io/docs/voice/pipelines/
- pierregillesl 3y agoNice! What languages do you support? (for STT & TTS)
- kkielhofner 3y agoThanks! STT is "just" a very heavily optimized (beyond even faster-whisper) Whisper implementation, so all of those languages[0]. For TTS we now use Coqui, which has a wide range of models with various voices, languages, etc. It even supports Meta MMS which has support for 1,100 languages[1]. [0] - https://github.com/openai/whisper#available-models-and-languages https://github.com/openai/whisper#available-models-and-langu... [1] - https://about.fb.com/news/2023/05/ai-massively-multilingual-speech-technology/ https://about.fb.com/news/2023/05/ai-massively-multilingual-...
- pierregillesl 3y agoOk! And what kind of hardware do your users run on? Do you get great quality of detection like Google Home/Alexa speakers?