4 ms·

Perhaps skip the whisper step if the video already has decent manual (not auto-generated) captions, like this video: https://youtu.be/i-BkN3rTK0Q https://youtu.

Perhaps skip the whisper step if the video already has decent manual (not auto-generated) captions, like this video: https://youtu.be/i-BkN3rTK0Q https://youtu.be/i-BkN3rTK0Q --- Another use case is being able to quickly jump to a specific spot inside a video. Could you add timestamps with links that jump directly to that point in the video? I accomplished something similar by modifying oTranscribe: - https://otranscribe.netlify.app/?vsl=definedefine https://otranscribe.netlify.app/?vsl=definedefine - https://otranscribe.netlify.app/?vsl=letter https://otranscribe.netlify.app/?vsl=letter --- Finally, I'm a windows user so a whisper.cpp version would be nice~

llimllib 2y ago
good idea! I've no idea how to distinguish between auto-generated and manual captions, but I definitely should take them if available. A timestamp flag is also a good idea. Will noodle on a whisper.cpp version! A question: on mac I can `brew install whisper-cpp`. Is there any equivalent way to install it on a windows machine? I haven't used windows in a very long time.
- Leftium 2y ago
  yt-dlp parameters distinguish between auto-generated and manual YouTube captions: # Downloads auto-generated captions yt-dlp --skip-download --write-auto-sub https://youtu.be/i-BkN3rTK0Q # Downloads manual captions yt-dlp --skip-download --write-sub https://youtu.be/i-BkN3rTK0Q # Fails with error: "There are no subtitles for the requested languages" yt-dlp --skip-download --write-sub https://youtu.be/ZMklf0vUl18 Docs: https://github.com/ytdl-org/youtube-dl?tab=readme-ov-file#subtitle-options https://github.com/ytdl-org/youtube-dl?tab=readme-ov-file#su...
  - llimllib 2y ago
    yeah, I found that when I was in there. I added an issue for tracking youtube CC support: https://github.com/llimllib/yt-transcribe/issues/2 https://github.com/llimllib/yt-transcribe/issues/2 with some thoughts about the challenges
- Leftium 2y ago
  On Windows, I use scoop.sh: https://scoop.sh/#/apps?q=whisper https://scoop.sh/#/apps?q=whisper I was able to do this: scoop install main/whisper-cpp mkdir models ## Download model file ggml-base.en.bin to models directory above yt-dlp.exe -x --audio-format wav --audio-quality 16K -o "out.wav" ZMklf0vUl18 # Wrangle wav into 16kHz format (param above did not seem to work...) ffmpeg -i out.wav -ar 16000 out-16kHz.wav whisper.exe out-16kHz.wav
  - llimllib 2y ago
    Presumably that used whisper's bundled tiny model, which is no better than youtube CC. A beef I have with whisper-cpp is that they totally refuse to handle model management. With mlx_whisper, I just have to tell it to use a model and it will download it if it's not already present: https://github.com/llimllib/yt-transcribe/blob/244841f83d83304710d1cedba5484cc53de61c9b/yt-transcribe#L236 https://github.com/llimllib/yt-transcribe/blob/244841f83d833... so if I add whisper.cpp as a dependency, I also have to add huggingface-cli or something similar. It also seems like huggingface-cli is not available on scoop
    - Leftium 2y ago
      Yes, the model must be downloaded separately (see my edited comment with bash commands/comments). The model is specified via whisper.exe `--model FNAME` parameter. By default, it looks for `models/ggml-base.en.bin`, but even that model must be downloaded separately. So you could do this: # Assumes ggml-large-v3.bin model file[1] was already downloaded to models/ folder whisper.exe --model models/ggml-large-v3.bin out-16kHz.wav [1]: https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-large-v3.bin https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-...
    - Leftium 2y ago
      Not as convenient, but you could also have the user manually install the model, like whisper does. Just forward the error message output by whisper, or even make a more user-friendly error message with instructions on how/where to download the models. Whisper does provide a simple bash script to download models: https://github.com/ggerganov/whisper.cpp/blob/master/models/download-ggml-model.sh https://github.com/ggerganov/whisper.cpp/blob/master/models/... (As a Windows user, I can run bash scripts via Git Bash for Windows[1]) [1]: https://git-scm.com/download/win https://git-scm.com/download/win

llimllib 2y ago

good idea! I've no idea how to distinguish between auto-generated and manual captions, but I definitely should take them if available. A timestamp flag is also a good idea. Will noodle on a whisper.cpp version! A question: on mac I can `brew install whisper-cpp`. Is there any equivalent way to install it on a windows machine? I haven't used windows in a very long time.

Leftium 2y ago
yt-dlp parameters distinguish between auto-generated and manual YouTube captions: # Downloads auto-generated captions yt-dlp --skip-download --write-auto-sub https://youtu.be/i-BkN3rTK0Q # Downloads manual captions yt-dlp --skip-download --write-sub https://youtu.be/i-BkN3rTK0Q # Fails with error: "There are no subtitles for the requested languages" yt-dlp --skip-download --write-sub https://youtu.be/ZMklf0vUl18 Docs: https://github.com/ytdl-org/youtube-dl?tab=readme-ov-file#subtitle-options https://github.com/ytdl-org/youtube-dl?tab=readme-ov-file#su...
- llimllib 2y ago
  yeah, I found that when I was in there. I added an issue for tracking youtube CC support: https://github.com/llimllib/yt-transcribe/issues/2 https://github.com/llimllib/yt-transcribe/issues/2 with some thoughts about the challenges
Leftium 2y ago
On Windows, I use scoop.sh: https://scoop.sh/#/apps?q=whisper https://scoop.sh/#/apps?q=whisper I was able to do this: scoop install main/whisper-cpp mkdir models ## Download model file ggml-base.en.bin to models directory above yt-dlp.exe -x --audio-format wav --audio-quality 16K -o "out.wav" ZMklf0vUl18 # Wrangle wav into 16kHz format (param above did not seem to work...) ffmpeg -i out.wav -ar 16000 out-16kHz.wav whisper.exe out-16kHz.wav
- llimllib 2y ago
  Presumably that used whisper's bundled tiny model, which is no better than youtube CC. A beef I have with whisper-cpp is that they totally refuse to handle model management. With mlx_whisper, I just have to tell it to use a model and it will download it if it's not already present: https://github.com/llimllib/yt-transcribe/blob/244841f83d83304710d1cedba5484cc53de61c9b/yt-transcribe#L236 https://github.com/llimllib/yt-transcribe/blob/244841f83d833... so if I add whisper.cpp as a dependency, I also have to add huggingface-cli or something similar. It also seems like huggingface-cli is not available on scoop
  - Leftium 2y ago
    Yes, the model must be downloaded separately (see my edited comment with bash commands/comments). The model is specified via whisper.exe `--model FNAME` parameter. By default, it looks for `models/ggml-base.en.bin`, but even that model must be downloaded separately. So you could do this: # Assumes ggml-large-v3.bin model file[1] was already downloaded to models/ folder whisper.exe --model models/ggml-large-v3.bin out-16kHz.wav [1]: https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-large-v3.bin https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-...
  - Leftium 2y ago
    Not as convenient, but you could also have the user manually install the model, like whisper does. Just forward the error message output by whisper, or even make a more user-friendly error message with instructions on how/where to download the models. Whisper does provide a simple bash script to download models: https://github.com/ggerganov/whisper.cpp/blob/master/models/download-ggml-model.sh https://github.com/ggerganov/whisper.cpp/blob/master/models/... (As a Windows user, I can run bash scripts via Git Bash for Windows[1]) [1]: https://git-scm.com/download/win https://git-scm.com/download/win