5 ms·

I need this, but for Vimeo videos.

messe 3y ago
It should be doable. What I built only works for videos with transcripts, but I've been looking to improve it using OpenAI's Whisper for Speech-To-Text. I'm just lazy so I haven't gotten around to it (...which is why I spent an hour throwing together a 30-line script to summarize youtube videos for me)
- f0e4c2f7 3y ago
  For you or anyone else reading this I recently ran across this video documenting setting up and using whisper. It's probably a little overdetailed, but I found the github docs a little underdetailed so might be useful. Whisper is pretty powerful. One of the more useful open source ai tools available right now. https://www.youtube.com/watch?v=XX-ET_-onYU https://www.youtube.com/watch?v=XX-ET_-onYU But as you implied in your comment, it should be possible to do it quite well with any video by transcripting with whisper and then sending the text to gpt or another LLM to summarize.
  - messe 3y ago
    I'll check it out (or maybe let my script check it out first), thanks. From what I remember the Whisper API docs weren't too bad, but I didn't try actually implementing anything, so you could be right that they're underdetailed.
  - cced 3y ago
    I’m currently working on this with the caveat that I want to do the work locally. Using whisper but the summarization portion if this task is not straightforward given the limited context size of models. Does anyone have any additional insight into this problem?
  - sethgecko 3y ago
    I’ve done something similar here https://github.com/mcdallas/summarize https://github.com/mcdallas/summarize it feeds an audio file to whisper and then summarizes the transcript. You can easily wrap it with yt-dlp to download the audio portion of a video
    - mkagenius 3y ago
      I also did the same but its a web app, https://github.com/mkagenius/audioGPT https://github.com/mkagenius/audioGPT (i also have it hosted but I am afraid if i post the link, it would eat through all my credits)
belter 3y ago
Maybe one for TikTok videos? Would be the scourge of influencers...

It should be doable. What I built only works for videos with transcripts, but I've been looking to improve it using OpenAI's Whisper for Speech-To-Text. I'm just lazy so I haven't gotten around to it (...which is why I spent an hour throwing together a 30-line script to summarize youtube videos for me)

f0e4c2f7 3y ago
For you or anyone else reading this I recently ran across this video documenting setting up and using whisper. It's probably a little overdetailed, but I found the github docs a little underdetailed so might be useful. Whisper is pretty powerful. One of the more useful open source ai tools available right now. https://www.youtube.com/watch?v=XX-ET_-onYU https://www.youtube.com/watch?v=XX-ET_-onYU But as you implied in your comment, it should be possible to do it quite well with any video by transcripting with whisper and then sending the text to gpt or another LLM to summarize.
- messe 3y ago
  I'll check it out (or maybe let my script check it out first), thanks. From what I remember the Whisper API docs weren't too bad, but I didn't try actually implementing anything, so you could be right that they're underdetailed.
- cced 3y ago
  I’m currently working on this with the caveat that I want to do the work locally. Using whisper but the summarization portion if this task is not straightforward given the limited context size of models. Does anyone have any additional insight into this problem?
- sethgecko 3y ago
  I’ve done something similar here https://github.com/mcdallas/summarize https://github.com/mcdallas/summarize it feeds an audio file to whisper and then summarizes the transcript. You can easily wrap it with yt-dlp to download the audio portion of a video
  - mkagenius 3y ago
    I also did the same but its a web app, https://github.com/mkagenius/audioGPT https://github.com/mkagenius/audioGPT (i also have it hosted but I am afraid if i post the link, it would eat through all my credits)

belter 3y ago

Maybe one for TikTok videos? Would be the scourge of influencers...