3 ms·
Just tested this on some developer podcasts which usually fail hard given they're full of technical jargon, brand names, etc. Whisper is a revolution! It's pick
by petercooper 4y ago
Just tested this on some developer podcasts which usually fail hard given they're full of technical jargon, brand names, etc. Whisper is a revolution! It's picking up terms like Heroku, DigitalOcean, GitHub, ECS, AWS, etc. and capitalizing properly - something nothing else did unless you provided a whole pile of guiding vocabulary.
- ma2rten 4y agoDid these podcasts have transcripts? You might be inadvertently evaluating it on data that it was trained on, which is basically cheating. Even if not, it might be trained on similar podcasts. Judging how good these kinds of models are is really hard.
- WiSaGaN 4y agoTrue. The test should only be done on the material released after the model.
- petercooper 4y agoNo transcripts, no. And recent episodes, within the past couple of weeks, so probably not part of the training either.