5 ms·
Anki and GPT-3
- SpaceManNabs 4y agothis is really cool. my first thoughts without thinking are: 1. how easy to set up ubuntu linux and using firefox lol. this is more on anki being somewhat frustrating sometimes. 2. i have tried using notes that i didn't make myself and there were pros and cons but bigger cons 3. that generated note didn't abide by the 20 rules which I find to be a pretty good guideline. that seems pretty fixable though!
- deleted 4y ago[deleted]
- gibolt 4y agoVideo of it in action (link from his site) https://twitter.com/i/status/1621025729013239813 https://twitter.com/i/status/1621025729013239813
- septillianator 4y agoi want this same thing for notion
- idearoots 4y agoyou could try https://neuracache.com/ https://neuracache.com/
- kiru_io 4y agocan you elaborate more?
- nullandvoid 4y agoIt already exists natively https://www.notion.so/product/ai https://www.notion.so/product/ai Use the "summarise" option.
- james-revisoai 4y agoTry saving your notion page as a PDF and upload it to StudyWand.com - I'd be super keen to hear your thoughts on the flashcards, which use a grounded LLM approach(Founder here).
- abdellah123 4y agoThis is a great idea. This is what note taking is lacking! When you pile up 200 notes or 2.000 ... you can push them into GPT to generate anki cards so that you can remember and make sense of it all.
- james-revisoai 4y agoAs the founder, I would love to hear your thoughts on StudyWand.com, which does this for PDFs/youtube videos, and has greater factual accuracy than base GPT models by quoting the source documents (thanks to a university grant): https://studywand.com/images/splash/getStudyingGIF.gif https://studywand.com/images/splash/getStudyingGIF.gif
- Bayes7 4y agoVery cool! However, I often feel like the process of generating the question/answer necessary for the Anki card is an important part of the learning process because it forces you do deeply think about the material and reflect on it. So I think there is a trade-off involved
- KVFinn 4y agoAbsolutely you lose a lot of effectiveness when you automate card creation. But it's still better than thinking, "Oh, I should make a card about this so I don't forget this important thing..." and never doing it. For me the biggest risk is being tempted to making way too many cards (because it's so fast and easy now!), end up with way too many reviews, and declaring Anki bankruptcy and uninstalling the app after a few months. I may done this more than once...
- rjh29 4y agoimo if you don't make the card then either: the word isn't important, or it comes up again, and you finally do make the card. It's not a big deal. I'm about 10 years on my Anki deck and have reached the same conclusion as you about keeping deck size down. A single card has a huge time investment if you add up the reviews. Even more if it's a bad card and you fail it a lot. As the words you learn get more and more niche, it's important to weigh up whether a card is worth making or keeping. I actively delete cards that make me feel 'meh' when I see them, or that I fail a lot, so I don't lose motivation.
- barking_biscuit 4y agoThese days I have a policy to just suspend once the interval hits six months, so that deck size has a max cap and can eventually go to zero if adds stop for a long enough period. Long enough to bootstrap niche words and hopefully maintain them through reading.
- kilroy123 4y agoWow this has given me so many ideas. I never even thought to have GPT make flash cards.
- Version467 4y agoAs a daily Anki user, I am highly skeptical of this idea. The careful creation of new cards is one of the key parts in learning the material. It promotes a critical thinking step where you have to distill the material down into small but important pieces and (if you want to do it well) forces you to evaluate if you have actually understood what you wrote down. I suspect that forgoing this step will not lead to understanding, but to rote memorization of trivia. Which is fine if that's your goal, but it leaves most of the potential of spaced repetition on the table.
- iotku 4y agoYep, a large aspect of flashcards when studying or the occasions when in college they allow you to bring notes to exams involves the aspect of personally curating the material and thinking about it during the process. Perhaps the gpt can find truly useful information, but if you don't know why it's useful you're just filling up your memory with material you don't know how to utilize well.
- rjh29 4y agoIt's a classic beginner mistake to load up a 20000 word deck and start learning it when you have no relationship or connection to the cards. Create a card when you first see the word in real life, with that example sentence on the back, and it's so much easier to remember. At least for me anyway.
- grandpoobah 4y agoThose large word decks can be useful though. Download deck, immediately suspend all cards, and then start un-suspending cards as you learn the words. I also add notes to the cards as I go. I have a similar strategy for the Ultimate Geography deck. I want to know where every country is on a map, as well as their capitol and flag. So I suspended all cards, and then periodically enable 20 new ones, and learn as I go. That often means googling the location or pronunciation the first time I encounter the card. (I use the low-key Anki configuration with Pass/Fail buttons plugin)
- 4y ago
- IanCal 4y agoThis is pretty cool. One of the things I think is hugely important about GPT3 is that it's paid for by the token. So for small users, it's pretty cheap, and it's fully workable for testing and experimentation.
- coffeeri 4y agoThis statement is accurate for testing and experimentation purposes. Additionally, the $18 starting credit provided by OpenAI is a nice bonus. I created a small Anki plugin that tags cards based on their content using the Text-Davinci-003 model. However, the cost quickly becomes prohibitive when a large number of tokens/ Anki cards need to be processed. To be fair that plugin is not working great, since tags should be viewed, merged and reused on a global scope.
- IanCal 4y agoAt 2 cents per 1000 tokens (~750 words), unless you're doing it a lot that should be quite manageable? That's ~$13 for 1000 cards of 500 words (prompt + card + tags). The smaller models are cheaper still and might perform well enough.
- coffeeri 4y agoI guess you are generally right. My prompts are lengthy, since I let GPT-3 handle the full html syntax of both sides, mathjax and so forth. I found the ada model to be not sufficient, but have not tried the other two models, I will try those! There is room for improvement on my side. From a budget-conscious student's perspective, this amounts to roughly $20 per semester in my case, just for the tags. Despite this, I am still fascinated by the automation possibilities offered by GPT-3.
- IanCal 4y agoThat's totally fair, I should be more conscious about different positions (and not get stuck in "as someone with a stable income..." thinking) and you're right these things can build. Curie as a model should cost 1/10th of Davinci - also the recent models are all better I think so if you've not tried them since the GPT-3.5 release it might be worth trying the smaller ones again. If you could get that to $2/semester it's a lot more palatable, as long as the quality isn't too bad. Maybe there's a flow where you can identify low performing cards/subsets so you can do 90% in Curie and 10% in Davinci. I think my expectation of this kind of service (on demand huge network) is fixed monthly fees, call us for pricing, etc. It's cool that it's approachable as a student. It'll be very interesting as costs for these things drop and/or performance improves at the same price points.
- azan_ 4y agoFrom my experience, automatically generated flashcards are often disappointing. Recently I've been experimenting with the use of GitHub copilot for accelerating cards creation and I can wholeheartedly recommend this approach, I've noticed at least 2x speed up in the process without sacrificing cards quality
- lenartowski 4y ago[dead]
- sason 4y agoCan you explain your process in more depth?
- yummytummy 4y agoVery cool! I've experimented with a similar thing for trivia questions based on Wikipedia articles. I'm also trying to reference the part of the text where the question was generated from, so the user can verify if it was correct or learn more about it in context. https://trivai.app/ https://trivai.app/ I currently require a sign up to generate questions, but the latest questions can be seen at https://trivai.app/latest-questions https://trivai.app/latest-questions
- hising 4y agoThis looks awesome, great example on how to use GPT-3 for fun and learning
- clbrmbr 4y ago> What is the belief in the existence of an afterlife called? Answer: ancestor worship. Then the explanation talks about the other three options, but does not reference afterlife. I wonder what went wrong?
- yummytummy 4y agoMe too! I’ve been experimenting with the prompt to try to make it provide better references and questions. Logged in users can upvote and downvote questions so the next step will be to try to fine tune the model on good questions.
- duwip 4y agoSilly question, but how does one get an Anki API Key? I've installed anki-connect and can't quite figure out where to get the key...
- cominous 4y agoYou can setup one in the anki-connect configuration - or just put in a dummy value that is ignored in case you dont have an Key set. You might still get 403 error, change the allowed origins to "*" in anki-connect.
- smallerfish 4y agoJust a side note on Anki - it sounds cool, but how is it possible that there are zero screenshots on the product page? Furthermore, it has a super busy (/intimidating-to-non-techies) download section, and the only real descriptive text is on the linked docs/help site, which is so dense that it is completely overwhelming to anybody who is still in "convince me" mode. The project would probably have 10x the number of users in 6 months if they learned how to do product marketing. https://apps.ankiweb.net/ https://apps.ankiweb.net/
- motoboi 4y agoAnki has been around for a decade, almost two. Several comercial competitors came and went over the years. I suppose it tells you something about the learning tools market.
- k4rli 4y agoI initially discovered it ~10 yrs ago as an alternative for Memrise back when all of Memrise courses were still free. UI/UX wise it seemed outdated-ish but overall very powerful. Glad to see this still going strong as FOSS.
- unhammer 4y agoNoo don't you'll flood the sync servers and then they'll have to put in ads and tracking and annoying animated birds to keep it all running
- knubie 4y agoThis is one of the reasons i made Mochi[0]. I couldn’t understand how this was the best recommendation for new people. Anki can be very useful and powerful but it is so user unfriendly as to be down right hostile. (Plus Mochi has GPT-3 built in [1]) [0] https://mochi.cards/ https://mochi.cards/ [1] https://twitter.com/MochiCardsApp/status/1603569008493711361 https://twitter.com/MochiCardsApp/status/1603569008493711361
- blakesterz 4y ago
- james-revisoai 4y agoReally cool to see! I totally agree that GPT models will revolutionise education, and a few thousand students are using a tool I've launched in that space that runs on PDFs and Youtube videos. It's specifically optimised LLMs to align with the Anki Minimum Information Principle, here's a 15 second GIF of StudyWand.com - https://studywand.com/images/splash/getStudyingGIF.gif https://studywand.com/images/splash/getStudyingGIF.gif ... showed it on r/GetStudying a few days back mentioning Anki MIP!: https://www.reddit.com/r/GetStudying/comments/10lg4ci/automatically_turn_lecture_slidesnotes_into_a/ https://www.reddit.com/r/GetStudying/comments/10lg4ci/automa... ... it has >98% recall on psychology (compare to between 70-95% recall depending on the subject for the SOTA AIs). We achieve this through quoted filtering - 80%+ of questions are quoted to specific slides or time stamps in YouTube videos. Would love to chat with you Tomte.
- wongarsu 4y agoWith the timing (ChatGPT out for about a month, GPT3 with close to identical capabilities in a different UI for 2.5 years) this announcement seems to add another datapoint that ChatGPT was a genious marketing campaign that pushes GPT adoption into the mainstream.
- anileated 4y agoWhy would you use LLM to create Anki cards when you can use said LLM to obtain the answer in the first place, eliminating the need to recall the information you are trying to remember with Anki?
- greenie_beans 4y agolol came here to say this. this defeats the purpose of anki
- somsak2 4y agowhy learn anything at all if you can just ask the LLM?
- anileated 4y agoThat’s the next logical step in the same argument.