4 ms·

Exciting to see. Curious if there was a benefit to using whisper over something like vosk which can transcribe on mobile device pretty decently. Whisper has o

• nshm 4y ago
  We did comparison of recent Vosk and Whisper models here: https://alphacephei.com/nsh/2022/10/22/whisper.html https://alphacephei.com/nsh/2022/10/22/whisper.html In general, Whisper is more accurate but much more resource heavy. Vosk runs on single core while Whisper needs all CPU cores. Accuracy difference for clean speech between Vosk-small and Whisper tiny is 2-3% absolute, 20% relative. Not sure how important is it, I would claim it is not that critical. Numbers there are for original Whisper. Whisper.cpp recommended here is actually 10% worse than stock Whisper for speed considerations. Not that simple. Vosk is streaming design, you get results with minimum latency of 200ms. Whisper requires you to wait for significant amount of time. If you refactor Whisper for lower latency you will loose a lot of accuracy advantage. Latency is very important for interactive applications like assistants. Whisper is multilingual and has punctuation, that is a clearly a good advantage. It also can use context properly improving for long recordings. So on mobile Vosk is still a viable option actually as many others mobile-focused engines. For server based transcription Whisper is certainly better. But not much better than Nvidia Nemo for example. Not that much publicity for the former though.