3 ms·
Is diarization only possible with stereo audio at the moment in whisper? If the voices aren't left/right split I don't think one can get them separated yet.
by siraben 3y ago
Is diarization only possible with stereo audio at the moment in whisper? If the voices aren't left/right split I don't think one can get them separated yet.
- pen2l 3y agoWhisper cannot perform speaker diarization at the moment, WhisperX and other solutions that can tend to use pyannot https://github.com/pyannote/pyannote-audio https://github.com/pyannote/pyannote-audio
- copypirate 3y agohttps://github.com/Wordcab/wordcab-transcribe https://github.com/Wordcab/wordcab-transcribe Author of Wordcab-Transcribe here. We use faster-whisper + NeMo for diarization, if you want to take a look.
- theossuary 3y agoNvidia's Nemo has some support for speaker recognition and speaker diarization too. https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/v1.0.0/asr/speaker_diarization/intro.html https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en...