3 ms·
The whisperX project has most of it covered they are integrating the new v3 model waiting for a ccp GGUF version also there is a workaround for the latest speak
by jimmySixDOF 3y ago
The whisperX project has most of it covered they are integrating the new v3 model waiting for a ccp GGUF version also there is a workaround for the latest speaker diarization but it has an active user base working on it
https://github.com/m-bain/whisperX https://github.com/m-bain/whisperX
- noman-land 3y agoI was dismayed to learn that this requires OpenAI API keys for speaker diarization.
- vsnf 3y agoDoes it? I only see references to HuggingFace api keys so it can do a one time download of some additional models.
- noman-land 3y agoOh, maybe that's what I saw. I'll have to look again. Thanks for keeping me honest.
- eigenvalue 3y agoThanks, took a look at it. Seems quite heavy though, lots of huge dependencies like pytorch and torchaudio, and seems like the speaker diarization requires a GPU if I'm not mistaken. And as another poster pointed out, it does require a Huggingface API key as well. I wanted to keep my script lighter weight and also GPU optional (i.e., a GPU will work and make it faster, but it also works acceptably with just the CPU). I really feel in my gut that the speaker diarization doesn't need to be so complicated or hard once you already have the accurate timestamps of each transcribed segment and the underlying audio file-- no reason why it shouldn't be able to run fine on a CPU and get good enough accuracy.