8 ms·
Youtube2Webpage: Create Websites with Text from Videos
- causi 3y agoI wonder if AI is soon going to be able to pull off the multimedia future I dreamed about as a kid, where no image is just an image, no video is just a video, no text is just text.
- hiccuphippo 3y agoJust last week I saw the opposite, a website that created videos from blogposts: https://www.rephrase.ai/blog-to-video https://www.rephrase.ai/blog-to-video While searching for its name I found several other services like this.
- fudged71 3y agoThis is great! What I’ve wanted for a long time is to use scene detection. So instead of a screenshot at regular intervals, it’s only when the visual scene changes. Maybe if the transcript were turned into paragraphs you could have a little gallery to the side for any scene changes during that paragraph.
- crazygringo 3y agoYes, that is exactly what I came here to comment! It seems "trivial" enough to detect a total shot change, and then in cases of things like fast-moving action sequences you just collapse all short shots into a single longer shot (e.g. all shots 5 seconds or less get collapsed together with any neighborhing shot 5 seconds or less). And then pick a single frame from the exact middle, or else the most "still" frame that shows the least change from neighboring ones.
- fudged71 3y agoHave started playing with this and ffmpeg has a scene change detection filter already so it should be fairly straightforward
- bilater 3y agoCool idea but it's still pretty minimal and hard to read. My tool YOU-TLDR allows you to search through the transcript in your language of choice side by side the video: https://www.you-tldr.com/ https://www.you-tldr.com/
- chocological 3y agoMy friend and I made something similar a few years ago as a college hackathon project - it features automatic scene transition detection and a rough editor before publishing the final results. (The demo site is down, but you can clone the repo and run the code locally) https://gitlab.com/chocological00/bitcamp-2021 https://gitlab.com/chocological00/bitcamp-2021
- riedel 3y agoI just had to write a research report for a funding agency with many subprojects and could not get one input so I took a short video from a pitch presentation and converted it first to captions using spech2text and then to a research summary and it was really impressive.
- politelemon 3y agoIf I'm remembering correctly the example they've used is the first video uploaded to YouTube. https://obra.github.io/Youtube2Webpage/example/ https://obra.github.io/Youtube2Webpage/example/
- obrajesse 3y agoThat’s correct.
- nicd 3y agoIt would be really neat if after pulling the captions, an LLM was used to reword the content into an idiomatic "blogpost" (since speech is typically different than writing). Using LLMs, we could even choose the level of summarization and the output tone! As someone who strongly prefers reading to watching instructional videos, I'd pay for this service :)
- zigzag312 3y agoOr at least chunk transcription onto logical groups. Chunking on the example webpage[1] is poor. [1] https://obra.github.io/Youtube2Webpage/example/ https://obra.github.io/Youtube2Webpage/example/
- column 3y agoYou can absolutely already do what you describe with GPT-4 plugins (Plus membership required). Using VoxScript and Video Insight : https://chat.openai.com/share/229e3ac8-3924-48e4-abd5-35bcb241ee99 https://chat.openai.com/share/229e3ac8-3924-48e4-abd5-35bcb2...
- micw 3y agoIt seems that many of "my script can do [something] with [information in a different form]" can be superseded by LLVMs already or in the near future and the quality is way better than what the scripts are capable of. I just wonder what the price of this is. I can run most of these scripts on an old laptop. But for the LLVM I need a pricy an beefy computer or (even worse) a paid subscription to a big tech's service.
- jdthedisciple 3y agoHonestly, I like the GPT 3.5 version I posted here way better.
- Etrnl_President 3y agoExcept for the complaining GPT will do, and some censorship based on the whims of its' programming group. No thanks; I'll stick to scripts, where the video dictates the content.
- jve 3y agoConstantly my brain gets a question: Can I search specific youtube video captions? Ok, this may be an answer... but is there an online service that given YT URL would spit captions out for me? Or maybe a browser extension? Maybe even youtube has a hidden link somwhere where I could see all the text? This submission triggered me for reasearch and found this gem: https://filmot.com/ https://filmot.com/ The guy who created it: https://www.reddit.com/r/linguistics/comments/oo8xbd/search_engine_over_370m_youtube_subtitles/ https://www.reddit.com/r/linguistics/comments/oo8xbd/search_...
- samuelg123 3y agoYouTube just added a feature to search transcripts. Seems like I might be in an experiment though
- bilater 3y agohttps://www.you-tldr.com/ https://www.you-tldr.com/
- prometheon1 3y agoShow HN: YouTube Full Text Search – Search all of a channel from the commandline https://news.ycombinator.com/item?id=36009774 https://news.ycombinator.com/item?id=36009774
- kalleboo 3y agoOn the YouTube website, if you click the "・・・" button next to share/clip/save, there is a "Show transcript" option and you can use your browsers in-page search to search in it
- kishmat 3y agothat's for specific vid, the site shared above lets you search Indexing over 760 million captions across 687 million videos and 52 million channels.
- twayt 3y agoAlso try www.askYouTube.ai, not exactly pure text search but it can help you find videos that answer your query using LLMs
- frabcus 3y agoRelated, this is a super useful end user app that summarises videos using an LLM: https://www.summarize.tech/ https://www.summarize.tech/
- stenioaraujo 3y agoThis is interesting. I think the scenario it should be used is for non sublte messages, such as sarcasm. I gave it a try with KRAZAM's video and the answer is hilarious when you consider the video intended exactly the opposite. https://www.summarize.tech/www.youtube.com/watch?v=_o7qjN3KF8U&ab_channel=KRAZAM https://www.summarize.tech/www.youtube.com/watch?v=_o7qjN3KF... > In "The Hustle," the narrator shares their jam-packed daily routine that exemplifies their dedication to productivity. From an early morning workout to late-night preparations for the next day, their schedule is filled with various activities. They efficiently manage their time, incorporating work, social media updates, and even a well-deserved happy hour. The narrator's commitment to self-improvement is also evident through their habit of reading before bed and tweeting inspiring quotes. Overall, this video highlights the narrator's hustle and structured approach to maximizing their day.
- iamflimflam1 3y agoYou really have to wonder what YouTube are doing. Trying to play catch up with TikTok instead of innovating with what they have. They’ve had transcriptions for ages - but it’s hidden away and practically useless. The things they could do with a bit of creative thinking…
- gumballindie 3y ago> creative thinking… The death of creative thinking is management and processes. Assembly line work doesnt permit creativity. Google is heading the same route as IBM and other once great corporations made by creative people. When the discussion shifts from ideas to processes and triviliaities it's game over. Long live whatever replaces google. It's over.
- conception 3y agoThere is a term in business for this I can’t remember. Where basically your money comes from business process X and so you protect X at all costs. Which makes it very difficult to innovate away from supporting X. It’s almost impossible for a company to pivot to making their money from Y. You see this classically in things like Sears, Woolworths etc. unable to keep up with the times. The solution to this seems to be to basically start a new company in your company completely separate from your core company more or less. Meta seems to have initially done this very well with their pivot from Facebook to Instagram. Perhaps less great in their metaverse pivot but we’ll see. Google set themselves up for success at this with alphabet but I don’t think we’ve really seen them be able to have something they feel like they can really pivot into yet so business X continues to be the focus.
- cal85 3y agoHidden away yes, but it’s amazing. It creates a totally new way of consuming informational videos and everyone here should try it. You can scroll through the transcription vertically and tap on any bit and the video instantly jumps to that point - basically the transcription is the new seek bar. And about 1000x better at the job. No more skipping back to somewhere roughly where you stopped paying attention and just letting it play for a bit until you get back into the thread - now you can jump around with surgical precision. It’s like how you can easily skim back and forth in a text article, but with a video. It’s a total game changer and I find it bizarre that it’s so hidden away so most people won’t find it. It also works particularly well when casting from your phone to a TV, using the phone as the navigator. Oh and the transcriptions are about 99% accurate, which is good enough for me.
- Hakeemmidan 3y agoThis is really cool, but why?
- robmccoll 3y agoI didn't create the tool, so I can't claim to know the author's intentions. To me, this would be very useful in a variety of circumstances: - the 15 minute video containing 3 minutes of useful information - tutorials that you're trying to follow step-by-step that have been tightly edited such that actually doing each step while following along is impossible - the video equivalent of listicles in which you're really only interested in the list, not the padding - quickly getting an idea of whether or not it's worth your time to watch a lengthy video by quickly scrubbing through the content
- jimmygrapes 3y agoI can usually read 10 minutes of spoken content in less than 3 minutes. Accompanying video is often useless, unless there are specific diagrams or illustrations/photos. I don't need to see someone's face moving to absorb the info. Probably lots of people out there with similar gripes.
- wahnfrieden 3y agoI'm working on adding this functionality to my iOS/macOS Japanese reading app, Manabi Reader. However since my app is essentially a web browser, it adds this functionality via userscripts instead of "youtube-dl" which Apple doesn't like. for future reference - https://reader.manabi.io https://reader.manabi.io
- bonyt 3y agoThis is actually potentially helpful for me as a lawyer for generating a paper record, and something I was talking about (and meaning to write up a script for) the other day. Sometimes I want to use a Youtube video in a court filing (for example, as prior art in a patent case), and submitting a rough paper record of the video like this is helpful along with the actual video.
- jjice 3y agoCool to see some Perl in a new repo. The thing I find most appealing about Perl is their backticks for going out to the shell. I know Ruby supports it too. I understand that this can be a security issue but I find the quick shelling out so powerful for a script that also needs to do some text processing or real programming logic that the shell just isn't great for.
- chefandy 3y agoWatch out for portability, too. Personally I would consider it a last resort exclusively for local system automation too complex for bash but for some reason python isn't available. I'm not going to pretend I understand everyone else's use case though so I'm glad it exists.
- wackget 3y agoFYI this isn't AI-powered or anything. It's not even doing speech-to-text synthesis. It just uses yt-dlp (youtube-dl) to download the video with its existing [auto-generated] subtitles from YouTube.
- obrajesse 3y agoYup! It’s basically a glorified shell script. Sometimes the old ways are useful. (I’m the author)
- siva7 3y agoFinally the web could be searchable again. If Google is clever they should pay big bucks for this as a last resort before getting strangled by Microsofts most important investment