3 ms·
I tried Whisper on an admittedly very challenging task (live translate Albanian to English subtitles), and it failed miserably. Went back and saw it had a 44% e
by pjc50 4y ago
I tried Whisper on an admittedly very challenging task (live translate Albanian to English subtitles), and it failed miserably. Went back and saw it had a 44% error rate for that language.
Might give it another go on an easier task.
- lajamerr 4y agoEven though Whisper advertises the translation part of it. I honestly wouldn't say it's a first class feature at least part of the Whisper model itself. The only thing I'd use Whisper for is transcription part of it. Then use ChatGPT for the translation.
- BatteryMountain 4y agoYeah the top 5 languages on that WER graph is very much worth a look, the rest a bit error prone. Surprisingly, I tested it with my mother, she has a very broken english accent/dialect and it worked fine for her. Works amazing actually and I'm busy building some tools around it for her to test.