3 ms·

How does this benchmark against AWS [0] offering? [0] https://aws.amazon.com/transcribe/ https://aws.amazon.com/transcribe/

• gamegoblin 4y ago
  I have done some tests for a hobby project (transcribing local fire station radio dispatch), and Whisper is incomparably better than AWS transcribe. Radio dispatch is very hard to understand, low quality audio. AWS transcribe was essentially useless, incomprehensible transcriptions. Whisper was 95+% accurate, with maybe 1 incorrect word per few sentences, and it was often easy to tell what the correct word would be.
  • boriscal 4y ago
    Interesting, that's good to know, my personal experience was that transcribe handled accents very poorly, but if whisper can handle radio static maybe it can also decipher thick scottish
    • blihp 4y ago
      Whisper has done extremely well for me with a number of challenging audio transcriptions: background noise, heavy accents, music playing... you name it.
    • paragraft 4y ago
      On the original blog post announcing Whisper there was a demo ("Accent" under the drop-down) of it transcribing a Scottish accent. https://openai.com/blog/whisper/ https://openai.com/blog/whisper/