3 ms·
You can duct tape together Whisper and GPT4All in a couple dozen lines of Python. It wasn't bad; I'm on a 3070 so it was slow, but tolerable (a couple seconds
by everforward 3y ago
You can duct tape together Whisper and GPT4All in a couple dozen lines of Python.
It wasn't bad; I'm on a 3070 so it was slow, but tolerable (a couple seconds of latency up to 5 or so seconds for the full Whisper+Mistral7B pipeline).
I named mine Jeeves, so at any point I could just "Ask Jeeves" (lol) and it would talk back to me. The TTS spoke slower than I would prefer, but I probably could have fixed it. I also should have prepended the prompt with something to encourage it to be brief. It often started reading out a couple of paragraphs of text.