4 ms·
A tool for capturing captions and transcripts from online videos
- jamesblonde 4y agoThere is a severless machine learning course that includes GH actions to implement serverless feature pipelines and serverless batch inference pipelines. https://github.com/featurestoreorg/serverless-ml-course https://github.com/featurestoreorg/serverless-ml-course Disclaimer: I am involved in it.
- lee101 4y agoAlso check out https://text-generator.io https://text-generator.io which is over 8x cheaper than Google for speech to text, 5.5 hours free every month too
- mtlynch 4y agoYou should disclose that this is your business, as the wording makes it seem like an unbiased recommendation.
- jimmySixDOF 4y agoIn the repo he says $0.20/min which seems quite high to me even roll your own like this. But I noticed that Otter.ai have downscaled their paid and free tier audio>txt min/month allotments as of last week so what used to get you 6000 now gets you 1200. They also capped the video file transcriptions so I wonder if costs are going up for some reason?
- deleted 4y ago[deleted]
- genewitch 4y agoyoutube-dl has --embed-subs and --convert-subs (currently supported: ass, lrc, srt, vtt) The automatic thing is interesting, and i'll have to check how to use whisper, i have a ton of old DVD rips that either have no subtitles or opensubtitles that have severe timing issues that make them unusable with a dumb player (like roku).
- culi 4y agoWow wish it could integrate with this: https://filmot.com/ https://filmot.com/ I'm constantly finding myself remembering a part of a video I saw a long time ago (e.g. Robert Sapolsky's hour-long lectures on human behavioral biology) and I've wasted more than a few days just trying to figure out which of his two dozen lectures it was. Filmot solved this for me, but I still have this problem with badly captioned videos or non-yt videos. This tool seems perfect for building a personal, searchable collection
- throwaway81523 4y agoI just use youtube-dl to get the youtube ttf captions and run them through a python script to clean up the timestamps and format somewhat readably. There are tons of transcription errors but it's still a lot faster than watching the stupid video.
- l8rlump 4y agoWould this give you a similar but quicker result? https://you-tldr.com/ https://you-tldr.com/ (No affiliation).
- IYasha 4y agoIf it was a DirectShow filter, we could just connect: containder demuxer -> audio decoder -> transcriber -> translator -> subtitle renderer :)
- mzs 4y agoblog post with details: https://simonwillison.net/2022/Sep/30/action-transcription/ https://simonwillison.net/2022/Sep/30/action-transcription/
- mmastrac 4y agoThis is an amazing "misuse"/hack of GitHub Actions and probably something that will cause major headaches for us in the future if they decide to crack down on it. I love it.
- sixhobbits 4y agoany activity that places a burden on our servers, where that burden is disproportionate to the benefits provided to users (for example, don't use Actions as a content delivery network or *as part of a serverless application*, but a low benefit Action could be ok if it’s also low burden); or Not a lawyer but pretty sure that is a violation of their ToS
- simonw 4y agoI'm very confident that what I've built here fits the set of things that you are allowed to do with Actions. The workflow I've written here is a shortcut for writing content directly to the repository. You could go and run the commands on your laptop and copy-and-paste the extracted captions into a file and push them to the repo... but Actions are specifically designed to automate that kind of process. (Also: I've shown this to GitHub people who have worked on Actions and they thought it was really cool.)
- latchkey 4y agoBeing confident/cool is irrelevant if GH legal decides that this isn't a valid use of their ToS. I would have reached out to GH to ask for permission instead of asking for forgiveness.
- simonw 4y agoI doubt GitHub have the support capacity to handle everyone pinging them to ask permission any time they want to do something interesting with Actions. I'll take my chances. If they tell me it's not a supported use-case, I'll update the project to tell people they shouldn't use it.
- fragmede 4y agoKeep building and ignore the haters. I'm sure Github deals with actual abuse issues with Github Actions (like trying to mine crypto) on a regular basis. This is neat and interesting and at most they'll rate limit it if it gets too popular. Plus you're connecting to a hosted paid service for the GPU backend side so it's not all CPU time.
- jackconsidine 4y agoWow that's cool. I've been using Whisper from a script I wrote which reads my Dropbox videos, transcribes them, and uploads both to Notion. If anyone's interested feel free to reach out. [0] I may pivot to this Github Action so my CPU doesn't explode. [0] jack at koptional dot com
- muratsu 4y agowhy not put it on a gist/github repo and share it here?
- simonw 4y agoThis is the wrong link - this is just to a demo of the system. https://simonwillison.net/2022/Sep/30/action-transcription/ https://simonwillison.net/2022/Sep/30/action-transcription/ is my full write-up of the project https://github.com/simonw/action-transcription https://github.com/simonw/action-transcription is the project repository.