6 ms·

This is really awesome, great work! I downloaded a long video from YouTube that is very challenging to transcribe (it is an interview with Hayek, who was both v

This is really awesome, great work! I downloaded a long video from YouTube that is very challenging to transcribe (it is an interview with Hayek, who was both very soft spoken and had a thick German accent) because I wanted to evaluate OpenAI’s claims about whisper being “superhuman” in recognition. It was a bit picky about having the audio in the exact right format (it needs to be 16kHz wav files— would be really nice it just include ffmpeg in the release and automatically pipe any input first to ffmpeg to convert to the desired format), but once it got started it just cranked away extremely quickly on my iMac M1. And the results do seem to be pretty good. I just wish the model also did some basic speaker identification, so it could insert “Speaker1:” or something at the beginning of each line/timestamp. Even if it’s not sure, it could insert “Speaker<?>:” and that would still be useful.

eigenvalue 4y ago
For those interested: Video link: https://www.youtube.com/watch?v=34Bre91Ey3Q https://www.youtube.com/watch?v=34Bre91Ey3Q Resulting transcript text: https://pastebin.com/5M1iW8yf https://pastebin.com/5M1iW8yf The whole thing took 1.5 minutes to run on an M1.
- eigenvalue 4y ago
  Part 2: https://pastebin.com/dEzpXLcL https://pastebin.com/dEzpXLcL
ggerganov 4y ago
Btw, there is the `yt-wsp.sh` helper script to download, convert and transcribe a video by given url: ./examples/yt-wsp.sh <video-url>
- eigenvalue 4y ago
  Ah thank you, I somehow missed that! Amazing job on this. You could literally create whole new companies from this system.
- eigenvalue 4y ago
  I actually couldn't get the script to work-- it keeps complaining that it can't find the Whisper executable. Do you know what I would have to do first to get it to work starting from a "blank slate" and cloning the repo? Thanks!
  - zimpenfish 4y ago
    It's trying to run `WHISPER_EXECUTABLE` which it defaults to `whisper` - but if you follow the instructions in the README, you end up with `main`. WHISPER_EXECUTABLE=main examples/yt-wsp.sh youtube_url Or the script itself prints out a handy hint. Whisper needs to be built into the main binary with make, then you can rename it to something like 'whisper' and add it to your PATH for convenience.

eigenvalue 4y ago

For those interested: Video link: https://www.youtube.com/watch?v=34Bre91Ey3Q https://www.youtube.com/watch?v=34Bre91Ey3Q Resulting transcript text: https://pastebin.com/5M1iW8yf https://pastebin.com/5M1iW8yf The whole thing took 1.5 minutes to run on an M1.

eigenvalue 4y ago
Part 2: https://pastebin.com/dEzpXLcL https://pastebin.com/dEzpXLcL

ggerganov 4y ago

Btw, there is the `yt-wsp.sh` helper script to download, convert and transcribe a video by given url: ./examples/yt-wsp.sh <video-url>

eigenvalue 4y ago
Ah thank you, I somehow missed that! Amazing job on this. You could literally create whole new companies from this system.
eigenvalue 4y ago
I actually couldn't get the script to work-- it keeps complaining that it can't find the Whisper executable. Do you know what I would have to do first to get it to work starting from a "blank slate" and cloning the repo? Thanks!
- zimpenfish 4y ago
  It's trying to run `WHISPER_EXECUTABLE` which it defaults to `whisper` - but if you follow the instructions in the README, you end up with `main`. WHISPER_EXECUTABLE=main examples/yt-wsp.sh youtube_url Or the script itself prints out a handy hint. Whisper needs to be built into the main binary with make, then you can rename it to something like 'whisper' and add it to your PATH for convenience.