4 ms·
Yeah exactly, 20x is on the high side these days. That's 1.5s for 30s of input, a bit slower than I get for ctranslate2 alone (basis for faster-whisper and whis
by claytonjy 3y ago
Yeah exactly, 20x is on the high side these days. That's 1.5s for 30s of input, a bit slower than I get for ctranslate2 alone (basis for faster-whisper and whisperX) on a V100 with the large model and beam size 5.
- FL33TW00D 3y agoLarge-V2 is only 2x faster than realtime on my M1 7 core GPU. 20x is for smaller variants.