8 ms·
Show HN: Anki/Duolingo-like app using educational YouTube videos
Hi HN,
I watch A LOT of educational YouTube videos but wasn't forgetting a good chunk of the details because I was only really passively watching. So I made a tool that generates quiz questions/flashcards from YouTube videos, and uses spaced repetition like Anki or Duolingo to keep it in memory.
Let me know if you find it cool/useful (or terrible ) or if you want to know a bit about the details!
- husarcik 3y agoWhat algorithm do you use for spaced repetition?
- kirill5pol 3y agoI have a fairly simple implementation of the SM-2 algorithm, and just making the assumption that if you answered the question correctly then you have “perfect recall”. This isn’t exactly correct but I have been using it myself and seems to still be pretty nice. But for the next version I want to use something called knowledge tracing to determine an estimated level of recall to then change the spacing
- jarrett-ye 3y agoI recommend the new algorithm of Anki: https://github.com/open-spaced-repetition/fsrs4anki https://github.com/open-spaced-repetition/fsrs4anki
- sstanfie 3y agothis looks great!
- vanijzen1 3y agoVery cool!
- deleted 3y ago[deleted]
- willmeyers 3y agoThe 30 minute limit is unfortunate, but otherwise it looks good. Thanks for sharing!
- kirill5pol 3y agoSo far it’s basically a heuristic for the video having both captions and the token count for generation be reliably under the limit, but I am working on making it work for arbitrary length videos! I did some tests for 2-3 hour podcasts and it worked pretty well
- clairegu123 3y agoNice
- jacknews 3y agoWho chooses the videos? It seems ... opinionated. For example, under 'Physics', we have "The big lie about carbon capture', 'Why (toilet) flushing isn't for everyone', 'The scientific basis for miracles', etc.
- kirill5pol 3y agoYeah it’s not ideal yet the suggestions under each category I just YouTube’s own category labels so often it didn’t give the best results, but it’s something I’m working on!
- dotancohen 3y agoPerhaps log the videos that users upload and suggest the most common ones?
- kirill5pol 3y agoYep planning on doing that but didn't have enough videos uploaded to "fill up" the categories before posting the Show HN, so I just scripted some stuff based on the YouTube suggestions from some YouTube channels I watch. One of my future plans is to actually train a BERT model to limit the video suggestions to something that actually is useful instead of clickbait... I have 2 different accounts on YouTube just so watching random videos on 1 won't pollute the suggestions from the other
- dotancohen 3y agoPerhaps allow the user to integrate with his YouTube history? Does YouTube have an API for that?
- snordgren 3y agoWhen I saw Anki/Duolingo in the bio I assumed it was for language learning, but this is a great idea! I too often watch these kinds of videos without really retaining a lot. This is a perfect complement to turn infotainment into time well spent, or at least, less wasted.
- jerpint 3y agoSame! Maybe someone could do some language learning on top of all the videos we consume on YouTube?
- patall 3y agoLanguagereactor.com seems to implement some form of that
- kirill5pol 3y agoYes!! I definitely spend a little too much time on YouTube myself, would you mind sharing what kind of content (categories) you watch in a pm? I’d love to get some better ideas of what kind of material to tune the question generations on
- danielwyb 3y agoNice! Would be great to use on longer videos and focus on specific topics of the video.
- sidwrestler 3y agoI love this new Plato app, it’s useful and I educational. The interface is also very clean
- Davana 3y agoYou just saved millions of students life's, A great tool that just solved a problem that existed but no one ever noticed
- totetsu 3y agoI want to make flash card form everything I look up this way.
- kirill5pol 3y agoAny particular type of content you’re thinking of? I’m currently working on adding podcasts since they’re pretty similar to YouTube videos, but I’m sure with some tuning I could see if it works for other things
- totetsu 3y agoPodcast is definitely one. But I’m not sure how one could get the real salient points out of some of the philosophy podcast I listen to without listening carefully the first time and writing them down.. Another would be for example when I ask Chatgpt how to do something in nvim.
- kirill5pol 3y agoMind sending me an pm? (my email's in my bio) I'd love to try it out with some of the podcasts/nvim chatgpt responses you mentioned and add it to your account!
- dotancohen 3y ago> Any particular type of content you’re thinking of? When the wife is mad and ranting, can you email me a summary at the end? With a quiz for the important parts.
- kirill5pol 3y agoNow that is a strong need haha, I think will have to be on the Plato premium + plan
- dotancohen 3y agoYou've got your first customer!
- pawelduda 3y agoI like the idea, but seeing how many new accounts added fake comments makes me a bit suspicious :)
- alexander2002 3y agoI really dont like the new accounts stigma due to statistical reasons but to each their own!
- bobmaxup 3y agoIs NLU really this reliable yet? I tried making some scripts like this with LLMs, and it seemed to do very poorly. So, I abandoned the effort.
- kirill5pol 3y agoI did quite a bit of that too, I really had trouble getting it to generate good content from scratch but here it's using the transcripts directly. I'm guessing it only really works well on scripts that are meant to be educational, because there already are "questions" implicit in the transcript of the video because that's the best way to present information when teaching something
- yogurtboy 3y agoThis is amazing! I tried a couple of videos and the questions seem pretty relevant and answerable (is there a better word for how a question is worded clearly and the provided answers seem clearly distinct and one of them is obviously correct), which is really hard to do by hand, much less by AI. I know you've addressed the video selection in the playlists, but I would highly suggest doing something to get it to differentiate "educational entertainment" videos (I notice a lot of Real Engineering and Economics Explained and CGP Grey videos) and actual education videos: primary-source explainers from teachers and subject-matter experts. The information density in the latter is way higher, and I think people overestimate the educational value of the former.
- ruune 3y ago> and I think people overestimate the educational value of the former. I disagree. Some people might overestimate how in-depth the information is, but the educational value of these videos lies in giving someone a basic understanding of something they otherwise wouldn't have learnt about at all. The lower information density helps making the video easier to understand and thus easier to consume, compared to something like a Havard class. If you want to learn something in-depth, an actual class, a book, etc. will of course always be better, but if that's neither required nor wanted, the infotainment is just fine.
- kirill5pol 3y agoYeah, I feel it's not ideal, but at least it's better than doom scrolling, and especially if it's a field that you're not familiar with having some simple explanations is still useful as a starting point
- alexander2002 3y agoOne point is if the end-user understand it is just infotainment and not a concrete guide.For example,People became "experts" on covid thorugh some videos that spread misinformation and became hardcore fanatics.This is just one example of many.
- balaji1 3y ago
- dotancohen 3y agoAmazing, thank you. It even works great for music videos, I never appreciated the poetic lyrical context of Pantera before. )) Small bug, the service requires a youtube.com URL and cannot handle an m.youtube.com URL, as happens when copying from a phone web browser or NewPipe. Perhaps you could support the mobile URL as well. Thanks, great work!
- kirill5pol 3y agoWell that music video lyrics work is a very unexpected pleasant surprise! :) Thanks for catching that! Will fix that!
- sebastianvoelkl 3y agoreally cool. A while back I've build this database of 1000+ hand-selected educational YouTube videos, so I'm going to try out a few of them to put in this tool :) https://www.edutube.app/ https://www.edutube.app/
- kirill5pol 3y agoThis is awesome! Did you hand select all 1000? I wanted to hand select for the categories to get some better starting recommendations but it was taking too long so I was a bit lazy and just scripted it…
- sebastianvoelkl 3y agoYeah I literally hand-selected all of them to remain the quality of videos that I wanted
- kirill5pol 3y agoIf you have a list of the IDs of the videos (and maybe categories) I can bulk add them! If you want to discuss a collab of some sort feel free to email me!
- yterdy 3y agoIf this works as I expect it to, it'll be something I've been hoping to see for a long time. Thank your for sharing it with us!
- kirill5pol 3y agoDo you have any specific type of content that you were trying to learn? Right now it's still pretty early/demo stage, but please pm me (email in bio), I'll see if I can tune it better to your use case!
- wahnfrieden 3y agoHow do you deal with YouTube Terms of Service for extracting transcripts?
- rmbyrro 3y agoInternational copyright agreements, like the Bern Convention, allow usage of content for educational purposes, as long as you're not replacing the original.
- deleted 3y ago[deleted]
- Ohuoko 3y ago[dead]
- owenpalmer 3y agoThis is fantastic! Is there a way to donate? This is the kind of software I want to see in the world!
- kirill5pol 3y agoPm me (email in bio) and I can come up with some sort of premium plan haha (I'm thinking unlimited time length for videos + podcasts/other material) but very open to suggestions!
- rollinDyno 3y agoI've always wanted to do this for Wikipedia, it could even be a Wikimedia add-on. However, I have recently transitioned towards becoming better at compiling information quickly rather than spending a chunk of my day memorizing facts that I am not quite sure will be useful.
- ListeningPie 3y agoWhat do you use to compile information and do you keep track of sources?
- rollinDyno 3y agoIt depends on the question. I do not have a list of sources.
- ListeningPie 3y agoDo you trust the information even after forgetting the source and not having the context your wrote it in?
- rollinDyno 3y agoWhen I say I compile information I mean I have a scratchpad in which I fill in the evidence that is relevant to my current needs. So I'll have the source noted there. What I'm trying to say is that I rarely go back to the scratchpad of a previous question / problem, but I will approach every question and problem with a new search. Trying to save information for the sake of it without knowing what future use it is going to have stresses me out, so I find that this fresh scratchpad approach works best for me.
- snakey 3y agoI’ve been doing something similar. If I read a blog post / paper, etc. where I learn a lot on a topic I’m interested in, I will catalogue a pdf of it in Obsidian with a tag and an optional note. This makes it easy to access information locally very quickly and I find I learn a lot more because if I forget something, I open up the resource, read the doc and, come out learning a little more. A kind of convoluted version of spaced-repetition but more passive learning. Granted, I’m aware this probably won’t scale to many topics but a few years and hundreds of notes later, it’s still working well for me.
- vivzkestrel 3y agoso how does this worK? you take the video and extract captions from it? and feed it to GPT? i am sorry, can you clarify?
- kirill5pol 3y agoPretty much! I'm working on doing some fancier stuff with knowledge tracing but was out of scope for the mvp
- puzzydunlop 3y agoThis is very cool! I'm trying to do something technically similar by using LLMs to summarize the meeting transcript from youtube (https://parths-newsletter-78dbcb.beehiiv.com/ https://parths-newsletter-78dbcb.beehiiv.com/). Right now I'm doing this manually by copy/pasting into ChatGPT but I want to automate this aspect. I'm not very technical so any guidance you could provide would be helpful :)
- allenz 3y agohttps://www.videogist.co https://www.videogist.co was mentioned previously on HN: https://news.ycombinator.com/item?id=38555629 https://news.ycombinator.com/item?id=38555629
- kirill5pol 3y agoPm me (email in bio) I can send you some scripts and point you in the right direction!
- hellcow 3y agoI like the idea. I’m learning European Portuguese, so I added a video but unfortunately got an error that there were no subtitles. The subtitles for the video in question are auto-generated, so maybe that’s the reason? Would be great if I could use this for foreign language studies.
- kirill5pol 3y agoAuto generated captions do work but unfortunately only English for now, it would be pretty easy to add other languages but I just haven’t had time to implement it yet. Feel free to pm me with the YouTube video I’ll try to see what’s the problem (email in bio)
- tayo42 3y agoWhat exactly are you looking to do with YouTube and language? I might have a github repo you could be interested in. It takes YouTube videos, creates transcripts, translations and creates audio anki flash cards from it with audio on the front and text on the back
- albert_e 3y agoThis is a cool idea. I wanted to have a bookmarking site that allows me to add my own time-stamped notes to YouTube videos I watch for learning purposes. I was using OneNote without any such features.
- schmorptron 3y agoOh my god, this is something I've wanted to make or see made for a while now! I'll definitely be using this, the design looks straight forward and good too! Any way to self-host to get around the 30 minute video limit?
- kirill5pol 3y agoYes! The 30 min limit was just a heuristic to make simplify some parts of the generation (almost always captions exist, so no need to run whisper, and 30 min is 4-5k tokens so very little chance of going over and needing multiple generations) Pm me (email in bio) and I can enable longer videos for you
- sonovice 3y agoGreat project! I had to laugh at the very first question I got, though: "Who is the sponsor of the video?"
- leoff 3y agoPlease drink your verification can to use this website.
- andruby 3y agoI love this! I wanted to build a “yt-campus” with a curated list of educational youtube channels. This does it better, thank you. One thing you could consider: allow your community to discuss the video’s. I’ve always wanted to have higher quality discussions about the Engineering videos I watch, and the YouTube comments really disappoint. Would you consider adding that? How about keeping your own personal notes per video?
- pavelboyko 3y agoLooks great! On a related note, I developed a similar free tool [1] designed for K12 teachers, primary focusing on curation and discovery of educational videos for classroom use. 1. https://hulahoop.ai https://hulahoop.ai
- qntmfred 3y agotimestamps on the transcript should be clickable to seek to that time in the video
- kirill5pol 3y agoI think there was some weirdness with resetting the iframe of the YouTube video when I first tried that, but I'll try to figure out a workaround!
- yungeeker 3y agoThis looks somehow like my app ClipMemo. The difference is that my app require you to create cards (called Memo in the app) by yourself. You select the start & end timestamp and you can review, repeat the clip. Besides YouTube it supports local video or other platform like Bilibili, China's counterpart of YouTube. I'm not sure wheather my idea works or your work does. I'm also curious about which workaround solve this problem better. You can find ClipMemo on App Store.
- maroonblazer 3y agoI love this, great work! One note: After submitting a video and answering the questions, the "New Videos to Watch" section appears to be videos similar to the one I uploaded, but may have not been uploaded to PlatoEdu. My expectation was that these were videos others had already uploaded and for which questions had already been generated. So I was surprised when I clicked on one and it started uploading. Had I known it was going to be added I wouldn't have clicked on it, as I'd first want to watch it to verify the content is high quality. Again, great work. Bookmarked!
- kirill5pol 3y agoYep, still working out UX kinks! Having the user wait for generations was kinda a pain when I was using it myself, but the upload mean that's its now "instant" when you get to questions. I'll try to fix this today or tomorrow! I'm thinking that it should generate the video content immediately but not add it to your account and instead ask the user.
- sebnun 3y agoNeat. I built a web app to learn languages that used podcasts and YouTube transcriptions too. The problem with YouTube was that their API was very limiting, so I ended up having to use a proxy and some unofficial API to scrape the videos. The whole thing felt very sketchy so I ended up removing the whole YouTube functionality and just focused on podcasts (https://langturbo.com https://langturbo.com) I hope you have better luck.
- realty_geek 3y agoI believe readlang has similar functionality.
- kristianp 3y agoSeems a great application of AI as part of a structured app, instead of just a chatbot.
- deleted 3y ago[deleted]
- mvkel 3y agoComparing this to duolingo is selling yourself short. Duolingo creates dopamine hits under the facade of learning a language (which you never do). With this, it's fun, and you can actually learn something.
- syncbehind 3y ago> Duolingo creates dopamine hits under the facade of learning a language (which you never do). If you're using duolingo as your only source for learning a language, yeah. It's a flashcard app when you get to brass tacks. You won't learn a language by only use flashcards. As a supplemental tool, it's great.
- kirill5pol 3y agoI think this is probably true for most things. Math, engineering, sciences; all need more than just memorization. But some other topics it may be enough for purposes that you would want to use something like Plato for (history, etc)
- kirill5pol 3y agoThat's the goal! :) I think it's kind of similar with Plato, the value you get is going to be really correlated to the quality of videos you put in (I'm working on making the suggestions here be better quality right now too) But I do think that there is still value to something like Duolingo, if it get's you to do at least a bit of learning over doom scrolling that's a good thing (even if it's much less effective than other methods). I think the problem comes up when something like Duolingo pretends to be better than it is and convinces people that otherwise WOULD be using the better techniques to learn, that's a bad thing, but if it's a replacement to nothing that's probably a net good (also I actually did use Duolingo to learn German (B1-ish), and it helped as a starting point for vocab and simple grammar, I learned the most with friends and time in Germany but I don't think I would've been able to take advantage of that time without Duolingo... but your milage vary)
- corderop 3y agoImpressive. This is a cool idea. Some improvements: - I tried with a Spanish video, and it told me it didn't have subtitles. - Would be supper cool to get them exported to Anki! Anyway, shouldn't be difficult to copy and paste it into Anki
- ellensatter 3y agohow do we access it?
- aorona 3y agoI like Anki but I feel like Duolingo has far too slow pacing to be practical