3 ms·

I have Whisper working in real time here, with TTS too for a real time voice AI that's much faster than ChatGPT's voice mode: https://www.microsoft.com/store/ap

I have Whisper working in real time here, with TTS too for a real time voice AI that's much faster than ChatGPT's voice mode: https://www.microsoft.com/store/apps/9NC624PBFGB7 https://www.microsoft.com/store/apps/9NC624PBFGB7 It's inefficient, but even older gaming GPUs are fast enough for real time performance, and accuracy is good. If you were going to train a model from scratch for real time you could do something more efficient, but it works as is. Edit: I'm not sure what you mean by "you wind up without context for the samples". You can supply context to Whisper.

alok-g 3y ago
Nice. >> Video Memory: 6 GB >> Graphics Processor: Nvidia GPU with 12 GB VRAM or greater Would it work on an x64 Intel i7 machine with 32 GB RAM and with Nvidia RTX3060 with 6 GB RAM.
- modeless 3y ago
  Unfortunately Microsoft's store doesn't allow requesting more than 6GB of VRAM in a store listing, so that's why it says 6 and 12 in the same listing. The lowest I've tested so far is a 3060 12GB. I wouldn't expect 6GB to work, but if you're willing to give it a try I'd be interested to know what happens. I'd like to support less VRAM. Maybe a future version will offload some of the processing to the cloud.