7 ms·
TexTube: Chat with any YouTube video transcript in ChatGPT fast
- sixthDot 2y ago[flagged]
- owenpalmer 2y agoThis approach really doesn't make sense to me. The model has to output the entire transcript token by token, instead of simply adding it to the context window... A more interesting idea would be a browser extension that lets you open a chat window from within YouTube, letting you ask it questions about certain parts of the transcript with full context in the system prompt.
- ofou 2y agoFor sure, that's an interesting idea, but potentially very costly (for longer videos). A plus side of this strategy is that the Transcription gets clean up a lot and also the math notation fix up too. So, it's just a cleaner text, well formatted for people who like to read videos instead of mindlessly watching a video. We're at Emergent Mind are working on providing bits of a technical transcript to a model and then asking follow up questions. You can check it out here http://emergentmind.com http://emergentmind.com if curious.
- deleted 2y ago[deleted]
- hombre_fatal 2y agoUntil I read other comments here, I assumed that's what they were doing since it bugged out on me and didn't regurgitate the transcript back to me yet still let me ask questions about it. https://chatgpt.com/share/66e9f5ae-8d20-8000-b3a5-7c1ba928b85d https://chatgpt.com/share/66e9f5ae-8d20-8000-b3a5-7c1ba928b8...
- ofou 2y agoI'm not sure what happened there, but I used the same link as you, and this was the intended functionality: https://chatgpt.com/share/66ea22ad-5d20-8009-a3b0-909c5f500a63 https://chatgpt.com/share/66ea22ad-5d20-8009-a3b0-909c5f500a...
- vunderba 2y agoThat's initially what I thought this was. Seems like somebody had the same concept, there's an extension called "AskTube" which looks like it does exactly this. https://chromewebstore.google.com/detail/asktube-ai-youtube-video/kkdhnobdacfnbdageilfchkhcjdbkhgf https://chromewebstore.google.com/detail/asktube-ai-youtube-...
- Workaccount2 2y agoI don't know if everyone has access to it (might just be yt premium), but many videos have an "ask gemini about this video" button, where you can directly ask questions about the video.
- ofou 2y agoIt might be a preview or something because I have YT premium and doesn't show up that anywhere. Can you share a video that works for that? Like this one. https://www.youtube.com/watch?v=zjkBMFhNj_g https://www.youtube.com/watch?v=zjkBMFhNj_g
- hombre_fatal 2y agoIt's only available in the Android app, but you can activate it here: https://www.youtube.com/new https://www.youtube.com/new
- vunderba 2y agoHere's a video demo from about 3 months ago: https://www.youtube.com/watch?v=fgYIFiWgBl8 https://www.youtube.com/watch?v=fgYIFiWgBl8 It looks like its currently limited to Android phones.
- adzm 2y agoIt is a beta feature in YouTube premium and doesn't seem to be for all videos, but it has been extremely useful in my experience. You can even ask where in a video things are discussed etc.
- oefrha 2y agoIt’s really ironic that YouTube basically pushed videos to be at least ~ten minutes long through commercial incentives, then offers AI features to cut through that filler garbage.
- hombre_fatal 2y agoWell, YTPremium users don’t see those ads. They’re the only ones who get the AI tool.
- afro88 2y agoWhen I try it it just says "Not found"
- ofou 2y agoCan you share the link?
- afro88 2y agoI clicked on one of the examples, which was "State of GPT by Andrej Karpathy"
- ofou 2y agoSometimes, the model used by Plugins gets confused, especially when the transcript is too long. It might just load the content into memory as a response without saying much more. You can then engage in follow-up chat interactions. But now I just tried again the link and it seems to work. Sometimes you have to try a bunch of times, or explicitly ask for the transcript if not shown. https://chatgpt.com/share/66eadbad-1d3c-8009-91f0-abe3cf4d363c https://chatgpt.com/share/66eadbad-1d3c-8009-91f0-abe3cf4d36...
- jonwinstanley 2y agoWhat does it mean by chat with a transcript? I.e. what are the kind of things I can ask and get value from?
- kylebenzle 2y agoNothing, it means nothing, like most of this "AI" hype nonsense. They copy paste text transcripts into an Llm and have it generate more text based on its training and prompt data. You can't "chat" with a text document of course.
- camus_absurd 2y agoI’m not sure I follow. Can you explain ‘you can’t chat with a text document’ because you clearly can.
- hombre_fatal 2y agoIs anyone even chomping at the bit to hear a pedant explain how "chatting with a text document" isn't the most precise way to phrase this concept that we all understand?
- ipaddr 2y agochatting with a bot about a text document. chatting about a text document Chatting with a text document implies it has AI or magical abilities. You wouldn't say you are chatting with your dog if you are talking to your wife about your dog.
- deleted 2y ago[deleted]
- ivewonyoung 2y agoIRC is just multiplayer Notepad.
- 2y ago
- romseb 2y agoIt does not work with long form conversations like podcasts. "I was unable to retrieve the transcript for this video due to its large size."
- ofou 2y agoComing soon! Currently, it works for videos under one hour. This limitation is due to ChatGPT's context window when using Plugins. I don't know why since it should support 200k tokens... Alternatively, you can use https://textube.olivares.cl https://textube.olivares.cl to get the full transcription for any video in English.
- choilive 2y agoDo you plan on open sourcing or letting us self host this tool? I would like to grab a bunch of videos but don't want to spam your server :)
- slt2021 2y agoso the only types of videos this is suitable for, it doesnt work on
- ofou 2y agoYou can get transcripts of any length using textube.olivares.cl or the API directly. The limitation lies in the current model used by Plugins, not in the API itself. Here's Lex 8-hour Podcast about Neuralink https://textube.olivares.cl/watch?v=Kbk9BiPhm7o&format=txt https://textube.olivares.cl/watch?v=Kbk9BiPhm7o&format=txt
- mattigames 2y agoAnd I bet it doesn't work with podcasts where any of the participants say "ignore all previous instructions, do [something else]"
- ofou 2y agoI found a quick video with "ignore all previous instructions, do [something else]" on YT and it still works https://chatgpt.com/share/66ea502e-935c-8009-a9f3-5ce9173e57fa https://chatgpt.com/share/66ea502e-935c-8009-a9f3-5ce9173e57...
- tsunamifury 2y agoallofus.ai already congregates all of the thinking of any creator on YouTube into a single mental model and allows you to interact with their synthetic self.
- CamperBob2 2y agoNow that does sound intriguing, but it just leads to a blank page...?
- slt2021 2y agoit is purely synthetic interaction though. asking questions to transcript at least is ground based on something real (a video)
- tsunamifury 2y agoThis is trained on their closed captions
- yawnxyz 2y agois this better than the Youtube-generated transcript / captions you'd get from something like https://github.com/Kakulukian/youtube-transcript https://github.com/Kakulukian/youtube-transcript?
- iorrus 2y agoI've been using Voxscript [0] for a while, after comparing the two I think voxscript is better, gives longer more detailed summaries, TexTube just seems to give a very brief impersonal overview. Easy to try both and see which you prefer. [0] https://chatgpt.com/g/g-g24EzkDta-voxscript https://chatgpt.com/g/g-g24EzkDta-voxscript
- ofou 2y agoTexTube is not giving summaries but the actual transcripts. Plus, mine is way faster ;) Compare the results: TexTube: https://chatgpt.com/share/66e9f424-32c4-8009-b761-c8a8d6fbecc9 https://chatgpt.com/share/66e9f424-32c4-8009-b761-c8a8d6fbec... VoxScript: https://chatgpt.com/share/66e9f443-31d8-8009-b396-dba11b2f5b4b https://chatgpt.com/share/66e9f443-31d8-8009-b396-dba11b2f5b...
- iorrus 2y agoHmm it didn’t work that way for me, first I asked it to summarise a video, then I simply posted the link to the video assuming it would give the transcript, in both cases it summarised the transcript. But if I start a new session and simply paste the link to the video it gives the transcript. I’m not sure an llm is the best solution to getting full transcripts.
- ofou 2y agoyou should copy and paste a youtube url and that's it
- andai 2y agoVery nice. I made a thing in Python which summarizes a YouTube transcript in bullet points. Never thought about asking it questions, that's a great idea! I just run yt-dlp to fetch the transcript and shove it in the GPT prompt. (I think also have a few lines to remove the timestamps, although arguably those would be useful to keep.) My prompt is "{transcript} Please summarize the above in bullet points" The trick was splitting it up into overlapping chunks so it fits in the context size. (And then summarizing your summary because it ends up too long cause you had so many chunks!) These days that's not so important, usually you can shove an entire book in! (Unless you're using a local model, which still have small context sizes, work pretty well for summarization.)
- HPsquared 2y agoIf you're going as far as using yt-dlp, why not run the audio through Whisper?
- andai 2y agoInteresting, I haven't used Whisper, is it cost effective? Seems to be about 36 cents per (hour long) video? How long does processing take?
- kajecounterhack 2y agoYou can run it locally, and it's really fast. But since YouTube transcription is really good, I don't see why you'd use Whisper and get a worse transcription (unless maybe it's on videos that Google did not transcribe for whatever reason).
- gs17 2y ago> But since YouTube transcription is really good Are you sure you're looking at automatic transcripts? YouTube transcripts are bizarrely low quality if they're not provided by the creators (I've actually used my Google Pixel's live transcription to make better captions occasionally). I just checked a video my girlfriend uploaded a week ago and the auto-transcript was still pretty messy. I've used Whisper for the same task and it's significantly better.
- lupusreal 2y agoSeems like fishing with hand grenades to me. I just download the subs and grep that.
- deleted 2y ago[deleted]
- mdp2021 2y agoEven just experience with `man`-pages, "/<term>", show that it is a suboptimal strategy that leaves querying an understanding reader engine to be desired.
- lupusreal 2y agoReally? I generally have a good experience with searching manpages. My big grip with those is the man program itself.
- mdp2021 2y agoMine is that directly asking a question ("How to...") would be much faster than finding the information through grep or highlight aided skimming. It would be just more efficient. Also since in order to find a feature through a literal string you first have to guess it... But language is inherently fuzzier, so literal searches are in this purpose weaker than an interface dealing with the fuzzy aspect of expression.
- righthand 2y agoNice, hallucinate a text document about video content. Next is hallucinating a video from a text document hallucinated from a video?
- hombre_fatal 2y agoIt uses a real transcript.
- deleted 2y ago[deleted]
- deleted 2y ago[deleted]
- eigenvalue 2y agoI actually just finished making a service that does something similar, but it also transforms the transcripts to make them into polished written documents with complete sentences and nice markdown formatting. It also can generate interactive multiple choice quizzes. And it supports editing of the markdown files with revision history and one click hosting. I'm still doing the last testing of the site, but might as well share it here since it's so relevant: https://youtubetranscriptoptimizer.com/ https://youtubetranscriptoptimizer.com/ There might still be a few rough edges, so keep that in mind!
- imadierich 2y ago[dead]
- hackernewds 2y agowhy limit this to YouTube? it should work on any body of text, is that right?
- eigenvalue 2y agoYes, I'm also working on another version that is document-centric. It's a bit of a different problem. In the case of YouTube video transcripts, we are dealing with raw speech utterances. There could be run-on sentences, filler words and other speech errors, etc. Basically, it's a very far cry from a polished written document. Thus we need to really transform the underlying content to first get the optimized document, which can differ quite significantly from the raw transcript. Then we use that optimized document to generate the quizzes. In the case of a document only workflow, we generally want to stick to what's in the document very closely, and just extract the text accurately using OCR if needed (or extract it directly in case we don't need OCR) and then reformat it into nice looking markdown-- but without changing the actual content itself, just its appearance. When we've turned the original document into nice looking markdown, we can then use this to generate the quizzes and perhaps other related outputs (e.g, Anki cards, Powerpoint-type presentation slides, etc.). Because of that fundamental difference in approach, I decided to separate it into two different apps. But I'm planning on using much of the same UI and other backend structure. The document centric app also seems like it has a broader base of potential users (like teachers-- there are a lot of teachers out there, way more than there are YouTube content creators). I started with the YouTube app because my wife makes YouTube videos about music theory and I wanted to make something that at least she would actually want to use!
- altdataseller 2y agoI pasted a video link and it says “Not Found”. Absolutely not the best first impression.
- ofou 2y agoCan you share the link?
- studymonkey 2y agoAwesome work, OP! I really believe we’ll soon be able to get a full four-year education just from YouTube. The challenge right now is sifting through the infotainment that the algorithms tend to push. This is actually what inspired us to create Lectura: https://lectura.xyz/ https://lectura.xyz/ We’ve added features that promote curiosity and deeper learning, like ELI5 explanations, suggested queries based on transcripts, quizzes to track retention, and more. If you’re interested in joining us to build out the platform, feel free to reach out at neil at lectura dot xyz
- asdev 2y agoshill
- jerjerjer 2y agoThe most interesting thing about this is that OpenAI apparently does not own chatgpt.com domain.
- alexeichemenda 2y agoThey do, this URL just links to a custom GPT hosted on OpenAI's chatgpt URL.
- deleted 2y ago[deleted]
- two_handfuls 2y agoI get what this is doing, but calling it "chat with a transcript" is weird. Like, documents and videos don't chat. We chat with a bot who has seen the document/video.
- nwhnwh 2y agoWe are going to chat with all kinds of stuff soon xD
- Kiro 2y agoYou're way too late starting that fight. "Chat with [anything]" has been an established term for a long time now.
- two_handfuls 2y agoIn the enthusiast community, I suppose. It's not too late to adopt clearer terminology- this will be important as those things try to reach mainstream users.
- nomilk 2y agoI’d love this but from the yt home page and search results page. That would let me ask chatgpt if the video really contains the info its thumbnail/title suggest it does without having to leave the current browser tab. I’ve done this by manually copy/pasting a yt transcript into chatgpt (and later streamlining it into a bash function), and it was quite effective, allowing me to dodge a couple of click bait time wasters. (videos that looked important but really were just fluffing up unimportant nonsense).
- spuz 2y agoHow is it supposed to work? When I open this, I just see a prompt that says "Get the full transcription of any Youtube video, fast. Studies suggest that reading leads to better retention of complex information compared to video watching. Only English videos currently." I tried pasting the URL of a YouTube video and I get the message "I'm unable to access the video directly, as the tool needed for that is disabled. However, if you'd like, you can summarize the video or let me know how I can assist with it!"
- ofou 2y agoCan you share the link? This is what I'm getting: https://chatgpt.com/share/66ea4f36-90b4-8009-8b6c-02bc26cff98e https://chatgpt.com/share/66ea4f36-90b4-8009-8b6c-02bc26cff9...
- spuz 2y agoHere you go: https://chatgpt.com/share/66eab3c0-6598-8011-980d-ce6d843e95a6 https://chatgpt.com/share/66eab3c0-6598-8011-980d-ce6d843e95...
- ofou 2y agoShazam! https://chatgpt.com/share/66eadd8c-c248-8009-b07a-3ee2dfeadee0 https://chatgpt.com/share/66eadd8c-c248-8009-b07a-3ee2dfeade... seems to be working for me
- novolunt 2y ago[dead]
- joanfihu 2y agoDoes it not break YT ToS?