3 ms·
I had a quick read through, maybe I missed something but is this all local run or does it need api access to OpenAI’s remote system? The reason I ask is that I
by WhackyIdeas 3y ago
I had a quick read through, maybe I missed something but is this all local run or does it need api access to OpenAI’s remote system?
The reason I ask is that I’m building something that does both TTS and STT using OpenAI, but I do not want to be sending a never ending stream of audio to OpenAI just for it to listen for a single command I will eventually give it.
If I can do all of this local and use Mistral instead, then I’d give it a go too.
- renus 3y agoEverything runs locally, we use: - WhisperLive for the transcription - https://github.com/collabora/WhisperLive https://github.com/collabora/WhisperLive - WhisperSpeech for the text-to-speech - https://github.com/collabora/WhisperSpeech https://github.com/collabora/WhisperSpeech and an LLM (phi-2, Mistral, etc.) in between
- WhackyIdeas 3y agoThank you! When I read OpenAI I was thinking would be going through them. This revelation is perfect timing for me… keeping user data even more private. Excellent!