13 ms·

One massively overlooked way to improve spaced repetition is to make easier cards. It's surprising just how easy an effective card can be. I started out using

by ekidd 3y ago

One massively overlooked way to improve spaced repetition is to make easier cards. It's surprising just how easy an effective card can be. I started out using Anki to learn French vocabulary. I'd make pairs of cards, with English on one side and French on the other. This started out easy, but became utterly brutal and depressing with several hundred cards in my deck. Too many near synonyms. I eventually took a hint from Katzumoto's Japanese advice, and started making cloze cards. I'd copy and paste an entire paragraph from an ebook or a web page, and hide just one word. These cards were easy, but also effective. Then I got lazier. I'd only hide half a word. Or I'd just boldface a word, and mark the card as a "pass" if I could sort of remember that word in context. And somehow, these cards actually worked better. Then I got lazier still. If seeing a card made me grown "Oh, not that card", I'd just delete it. If I missed a card 3 times, I configured Anki to permanently suspend it. If I actually needed to know a word, no worries, I'd see it again soon in a more helpful context. And my French vocabulary continued to grow by leaps and bounds. I don't think that biggest improvements will come from better spaced repetition algorithms. I suspect the biggest wins will come from improved card formats. And it's surprisingly hard to make a card too easy to be useful. (Source: 35,000+ Anki reps across three languages.)

piazz 3y ago
This is great, going to try this approach with my Japanese Anki reps. Mind linking out to Katzumoto’s Anki advice? Is this this one? https://tatsumoto-ren.github.io/blog/setting-up-anki.html https://tatsumoto-ren.github.io/blog/setting-up-anki.html
jwells89 3y ago
I’ve been using Anki on and off for years for language learning but have most recently been using it to study for online uni courses. Something that’s become evident, perhaps due to the varied nature of the content (vs. all language) is how much gravity card formatting has. In decks made by others I find myself frequently re-wording the answer sides of the cards which makes a noticeable difference in retention — answers that are succinct and flow nicely stick better. So in short, I’d concur. Card format is important. If you find a card that feels awkward somehow don’t hesitate to rework it.
tetha 3y ago
I'm kind of wondering the same thing learning my guitar: Maybe a good thing is to approach an issue with different ways your head has to think about it. Like, yes. I can just spaced repetition the heck out of the notes on the fretboard. Just hammer my head into the notes on a string until I pretty much just give up. Always an idea. But I've found it more effective to mix contexts up. Some weeks, I just drill notes because I'm lazy. But then I also start tinkering around for a week with some weird scale, like hungarian scales and such. Some other week, I'm tinkering around with arpeggio chords, some other week with cord progressions with power chords, some weeks I'm trying to replicate some sound or feeling of a song. And over time, the brain is putting things together. Suddenly there are realizations: Hey, this is just a G-Minor scale, which makes sense for a somewhat solemn song. Oh, this is just a G-Major scale but we skip those. Wait, I remeber half the notes of the scale, isn't this just that pattern? Also, if the scale is like this, couldn't we try playing that? It's just a weird feeling, because the amount of things I think I know expands at a much lower rate of the things I realize I don't know - or don't have the technique for, lol. But I'm kind of considering using a spaced repetition algorithm to just poke for 5 to 10 minute guitar things to do to get both the muscle memory and the neural connections about them going.
- epiccoleman 3y ago
  I've thought about doing this too - and there are certainly things that are worth rote memorization on guitar. But my experience has been that things stick a million times better when I learn them in context and really focus on using them, so I'm unsure how useful implementing spaced repetition would be vs "just play yer guitar". That said, the notes on the fretboard is well worth the effort of rote memorization. I found the technique in this video[1] worked absurdly well for me. Years and years of only knowing the notes half-assed and not very well on the middle three strings got absolutely busted after doing this for a few minutes every time I was waiting on a build or something. I can nearly always find a note now, I'm not quite to instant recall but have substantially more ability in this regard now. A place where spaced repetition might be worth it is in memorizing all the triads or keys, which is good to have instant recall on. I have these decently in my head but usually have to "convert" from a nearby chord in C major for oddball ones, which is fine while practicing but not what you'd want for performance. [1]: https://youtu.be/PJddQ6Q0UDo?si=4dmR7_tlsWIhgvYg https://youtu.be/PJddQ6Q0UDo?si=4dmR7_tlsWIhgvYg
jnsie 3y ago
Truly sorry to hijack, but if you have any recommendations for shared French vocab cards I'd greatly appreciate you pointing me in the right direction. I have some French from school, but would like to get back into it and it's...daunting.
- barrell 3y ago
  Sorry to hijack your hijack, but I was/am in a similar position with my French/Italian/Portuguese/Dutch and more. I learned them to a high B low C level, but they've since faded from memory. Trying to learn from language resources is painfully slow. Trying to watch TV or listens to podcasts is ineffectively difficult. I'm building Phrasing[1] to tackle just this problem. We've just launched with all of the base functionality[2], including automatic analysis of native material to surface the most important words, phrases, and quotes specific to that material. We then make it dead simple to create flashcards-on-steroids which will automatically be applicable as flip cards, cloze cards, audio cards, and more. When it comes to SRS, we: - use our own fork of FSRS coincidentally (that's why I'm here hey ) - do away with scheduled due dates and actually try to keep the user engaged at a specific difficulty (you'll only see hard cards if you're doing well and 'can afford' it, you'll see easier cards if you're not doing well) - dose out new reviews constantly, as it's better to make forward progress then to bang your head against all those challenging reviews We just onboarded our second cohort of users, but we're planning to onboard another cohort at the end of this month. If you're interested you can fill out the beta application [1] https://phrasing.app/ https://phrasing.app/ [2] https://blog.phrasing.app/phrasing-first-look https://blog.phrasing.app/phrasing-first-look
rpb92 3y ago
You've inspired me to rethink my approach to Anki. I've used it on and off for the last few years, but always fall in the trap of creating cards that were too convoluted. Sounds like I could benefit from some deliberate "laziness". Did you ever feel like you were answering correctly, on close cards specifically, not because of an improved understanding but because you were associating the correct answer with the prompt/excerpt? Would appreciate any advice on how to avoid this!
- ekidd 3y ago
  > Did you ever feel like you were answering correctly, on close cards specifically, not because of an improved understanding but because you were associating the correct answer with the prompt/excerpt? I actually suspect that associating the word with the context helps, as surprising as that might be. Let's say I grab a few sentences from an interesting article, and I boldface a word. I'll mark the card as "pass" if I at least sort of understand it in context. On day 1, I honestly might find the word fairly confusing. I can explain what it means, but maybe the grammar is unfamiliar. Ditto for the first few reviews. But then around day 8 or so, the card disappears until day 20 or 30. And the next time I see that card, suddenly the odd bit of grammar is completely natural and obvious. There's maybe some kind of medium-term memory consolidation mechanism occurring? Something happens when I'm not looking at it. Seeing the word in context somehow allows my brain to grab on. The human brain contains some incredibly powerful language learning machinery. In adults, that machinery still exists. Even if it's a bit rusty. And that machinery seems to work best on semi-comprehensible speech in a natural context. So think of Anki less as a set of facts you must learn, and more as a tool to distill and concentrate natural language so that you can let your brain work on your weak points. (And as soon as possible, start reading lots of books and watching TV! I learned the hardest 10% of my vocabulary using Anki, and much of the rest from context reading books.) Also, I find it fascinating that LLMs are trained using a very similar process. Either "predict the next word" or "fill in the blank". Now, they need a lot more input than any human does, but the fact that fill-in-the-blanks works so well in both cases is fascinating. Here are two of the most interesting experiments I tried with Anki: http://www.randomhacks.net/substudy/ http://www.randomhacks.net/substudy/ https://blog.beeminder.com/hieroglyphs/ https://blog.beeminder.com/hieroglyphs/ (The only language I ever bothered to push to a high level was French. Spanish and ancient Egyptian were basically experiments to see how quickly I could pick up the basics, using the tricks I learned while working on French. A language that you can use at a professional level is a bit like a pet; it requires ongoing care.)
jacquesm 3y ago
You have absolutely nailed it. Anki should work as a sliding window on material that you wish to learn not as an ever increasing bucket with more and more stuff in it. That way the new material will always be underexposed. It's much better to keep moving. I have the exact same patterns with learning pieces to play on the piano, and within those pieces you see those patterns again (it's almost a fractal).
fudged71 3y ago
Love this idea! Does Anki or any of its plugins support creating a difficulty progression when creating cards? ie. half-word cloze, then full-word, then multiple choice, then q&a, etc. I’m not sure how this would work in practice. Like would the next difficulty card be added to the deck once the easier card has reached a threshold?
- cdwhite 3y ago
  In relatively recent versions of Anki, you can create nested Cloze deletions: "{{c3::{{c1::foo}}{{c2::bar}}}}" will show you cards "[...]bar", "foo[...]", and "[...]", in that order, all with answers "foobar". As for multiple choice and q&a---my practice is to make both Cloze and basic cards for, well, most things---Cloze are good for the early steps and for seeing how different pieces fit together, but basic cards are more demanding, and without them I don't quite feel like I've learned a thing. (FWIW my primary use is physics & the mathematics behind it, not language learning.)
bluquark 3y ago
For what it's worth I've gone the opposite direction (one language, 70k Anki reps). For me, carefully adding context has largely felt like time wasted at card creation time (which can a surprisingly large proportion of study time per card, given how brisk reviewing usually is) and I've been bothering with it less and less. The default simple cards my dictionary plugin creates are usually good enough for me. I go out of my way to add context on the front of the card now mostly when it's a specialized word almost always seen within that context (so there's zero added value in learning it independently). I do agree with the general idea that laziness and going easy on yourself is good though. I give myself quite a lot of slack when grading my answers, applying a "my understanding of this word is close enough to avoid confusion in practice" threshold rather than some impractical ideal of native-level mastery.
- ekidd 3y ago
  > For me, carefully adding context has largely felt like time wasted at card creation time I actually had several custom tools that heavily automated card creation—I could grab a sentence from a web page, or bulk import highlighted phrases from an ebook. Then I had a UI which allowed me to easily highlight an interesting word, and either cloze it, or add a Wiktionary definition on the back. Then I had an Anki plugin to bulk import the cards. This could all obviously be combined into a single tool, and occasionally someone tries. For my most heavily automated experiment, I used a tool similar to subs2srs to import sound, bilingual subtitles, and tiny screen captures from 4 episodes of Avatar: The Last Airbender. That was a fascinating experience, and I'm still earwormed with the dialogue of those episodes a decade later, after only a couple of months of Anki reviews. (See elsewhere in this thread for a link.) Unfortunately, I'm not convinced that there's a good startup market for language-learning tools. Language learning is normally aspirational, much like a gym membership. And customers don't have any serious plans on how to reach their stated goals. (Again, like a gym membership.) Duolingo isn't terrible, but I suspect—based on lots of Anki experiments—that it should be possible to build much more effective tools than Duolingo. I'm just not convinced that anyone but serious ESL students would pay for them. Too many genuinely good tools in this space have sunken quietly, despite a user-friendly UI and a good landing page.
steve1977 3y ago
> One massively overlooked way to improve spaced repetition is to make easier cards. At least with SuperMemo, this is actually one of their main tips. See also: https://supermemo.guru/wiki/20_rules_of_knowledge_formulation https://supermemo.guru/wiki/20_rules_of_knowledge_formulatio...
dataangel 3y ago
Huh, hiding part of a word is brilliant. I never thought to do that even though I made tons of cloze cards.
huimang 3y ago
What killed Anki for me was having to add cards. It is such a chore adding single word cards. I also ran into the problem of increasingly niche synonyms that I'd learn, but would rarely see in text. For some reason I never really considered cloze cards. The anki default of 8 relapses before suspending a card is much too high. It took me a while to realize, but dealing with problematic cards takes up -way- more energy than learning new cards... it's not energy/time efficient at all. Do you have any recommended sources on cloze style cards? [45k reps here for Korean]
jamager 3y ago
> I don't think that biggest improvements will come from better spaced repetition algorithms Exactly that, specially for language learning. The stated goal of hitting a target probability is pointless IMO. Language acquisition is not about memorizing words, but progressive familiarization (eg via retrieval practice). You have to expose yourself to massive amounts of language, create your own cards fast, review them faster, move on even if you "fail", don't do too many repetitions (6-8 should be enough for >95% of cards) The most important aspect of an SRS algorithm is to be practical: sensible choices, equally spaced out among them, that allow you to decrease / maintain / increase intervals without ever punishing you for failing.
neves 3y ago
The original SuperMemo 20 rules for creating SRS cards are a treasure trove: https://www.supermemo.com/en/blog/twenty-rules-of-formulating-knowledge https://www.supermemo.com/en/blog/twenty-rules-of-formulatin... It will improve a lot your cards
callistus 3y ago
I've found Andy Matuschak's essay, _How to write good prompts_ [1] very helpful in making more impactful cards. https://andymatuschak.org/prompts/ https://andymatuschak.org/prompts/
- deleted 3y ago
  [deleted]
- AlchemistCamp 3y ago
  What were the key insights or surprises you got from that 13,000 word piece? For background, I contributed to Anki long ago, wrote regularly about SRS in the late 2000s and got deeply into them for language learning for a few years. Later, I mostly stopped using them since I found extensive reading both more interesting and a better return on my time. I’m interested in the topic but am not new to it.
laurieg 3y ago
You're doing SRS right! Geeks like us love to get into SRS algorithms and chase after the 1% improvements with a cleverer repetition algorithm or a better input method. The real failure mode is much more mundane: People give up. I see it all the time. People cram thousands of cards into Anki in their first month learning something. After a month or two they are so overwhelmed with reviews and the reviews become such a chore that they just give up. (Of course, there are people who manage to add thousands of cards every month for years and years. These are the people who would probably do nearly as well with just a pen and paper. ) Two pieces of advice that make all the difference: Make your cards a little bit 'too' easy and be rather selective with your cards. When you first make a card you're probably actively studying the subject of the card. You're very familiar with it and it's all in your head right now. The temptation is to make a card that is fun and challenging for you right now. Resist! Instead, make a card that feels slightly too easy, so that in a week or two it will be enough to tickle your memory rather than confuse you. Also, people dump entire books worth of sentences into Anki. I like to use the metaphor of walking through an orchard: take your time, look around and grab one or two of the nicest apples you find. If you try to grab everything you're only going to slow yourself down. Also, if you pick up a rotten apple (uninteresting/too difficult card) it pollutes your entire deck. You start to resist review your flashcards.
- cratermoon 3y ago
  Is there really any solid research determining the "best" algorithm, or even ranking them? As best I can tell, any process to repeat wrong answers more often and the correct answers less often, and does so with some amount of increasing time delta, will work. But I have yet to see any proof that one algorithm is better than another.
  - bryanrasmussen 3y ago
    I mean this any process that you suggest is a set of algorithms. It would seem logically strange to suggest that when a method is not within the set of algorithms it will not work, but as soon as any method is used that repeats "wrong answers more often and the correct answers less often, and does so with some amount of increasing time delta" it will work equally well with other methods. I would suspect if this does appear to be the case that there probably is an optimal algorithm to start with but that all methods chosen here decrease in utility if you stay with the same variables (repetition frequency of wrong answers, repetition frequency of correct answers, time delta) for too long, the same way there are beneficial exercise methods for getting specific results when starting out that need to be varied if you want to keep getting results in that area without a decrease in the quality of the results.
jarrett-ye 3y ago
Yeah. I'm the author of FSRS and I agree with you. In my opinion, the quality of cards determines the upper limit and the algorithm just helps you achieve the upper limit efficiently.
kqr 3y ago
This is right. I tried and gave up on spaced repetition a few years ago. When I tried again a year ago and did more research, I realised my problem on the first attempt was that I made too complicated cards. I went back and dug up some of my more valuable cards from my last attempt, and some of them were so complicated that I had to break them up into 10–15 cards now that I know how to design good cards. That said, I don't think the point is to make them easy. Since you want to aim for a 90-something percent success rate to get the most benefit out of it, too easy will make the going slower. The point is to make them atomic and that usually feels easy, even if you fail 10 % of recall tests.
barrell 3y ago
We've got pretty similar ideas on SRS. I'm working on Phrasing.app, we use (a heavily modified version of) FSRS and have implemented a lot of what you're talking about. We just had a company retreat where we talked about new review modalities and several of these ideas came up. If it looks at all interesting to you [1], I'd love to chat more and hear more about your experience / approach / etc. Feel free to reach out at ben [at] phrasing [dot] app [1] https://blog.phrasing.app/phrasing-first-look/ https://blog.phrasing.app/phrasing-first-look/
vjk800 3y ago
Someone could make an NLP algorithm to determine whether a given card is well made. Training data could just deleted/non-deleted cards from a power users such as you.

by ekidd 3y ago

piazz 3y ago

This is great, going to try this approach with my Japanese Anki reps. Mind linking out to Katzumoto’s Anki advice? Is this this one? https://tatsumoto-ren.github.io/blog/setting-up-anki.html https://tatsumoto-ren.github.io/blog/setting-up-anki.html

jwells89 3y ago

I’ve been using Anki on and off for years for language learning but have most recently been using it to study for online uni courses. Something that’s become evident, perhaps due to the varied nature of the content (vs. all language) is how much gravity card formatting has. In decks made by others I find myself frequently re-wording the answer sides of the cards which makes a noticeable difference in retention — answers that are succinct and flow nicely stick better. So in short, I’d concur. Card format is important. If you find a card that feels awkward somehow don’t hesitate to rework it.

tetha 3y ago

I'm kind of wondering the same thing learning my guitar: Maybe a good thing is to approach an issue with different ways your head has to think about it. Like, yes. I can just spaced repetition the heck out of the notes on the fretboard. Just hammer my head into the notes on a string until I pretty much just give up. Always an idea. But I've found it more effective to mix contexts up. Some weeks, I just drill notes because I'm lazy. But then I also start tinkering around for a week with some weird scale, like hungarian scales and such. Some other week, I'm tinkering around with arpeggio chords, some other week with cord progressions with power chords, some weeks I'm trying to replicate some sound or feeling of a song. And over time, the brain is putting things together. Suddenly there are realizations: Hey, this is just a G-Minor scale, which makes sense for a somewhat solemn song. Oh, this is just a G-Major scale but we skip those. Wait, I remeber half the notes of the scale, isn't this just that pattern? Also, if the scale is like this, couldn't we try playing that? It's just a weird feeling, because the amount of things I think I know expands at a much lower rate of the things I realize I don't know - or don't have the technique for, lol. But I'm kind of considering using a spaced repetition algorithm to just poke for 5 to 10 minute guitar things to do to get both the muscle memory and the neural connections about them going.

epiccoleman 3y ago
I've thought about doing this too - and there are certainly things that are worth rote memorization on guitar. But my experience has been that things stick a million times better when I learn them in context and really focus on using them, so I'm unsure how useful implementing spaced repetition would be vs "just play yer guitar". That said, the notes on the fretboard is well worth the effort of rote memorization. I found the technique in this video[1] worked absurdly well for me. Years and years of only knowing the notes half-assed and not very well on the middle three strings got absolutely busted after doing this for a few minutes every time I was waiting on a build or something. I can nearly always find a note now, I'm not quite to instant recall but have substantially more ability in this regard now. A place where spaced repetition might be worth it is in memorizing all the triads or keys, which is good to have instant recall on. I have these decently in my head but usually have to "convert" from a nearby chord in C major for oddball ones, which is fine while practicing but not what you'd want for performance. [1]: https://youtu.be/PJddQ6Q0UDo?si=4dmR7_tlsWIhgvYg https://youtu.be/PJddQ6Q0UDo?si=4dmR7_tlsWIhgvYg

jnsie 3y ago

Truly sorry to hijack, but if you have any recommendations for shared French vocab cards I'd greatly appreciate you pointing me in the right direction. I have some French from school, but would like to get back into it and it's...daunting.

barrell 3y ago
Sorry to hijack your hijack, but I was/am in a similar position with my French/Italian/Portuguese/Dutch and more. I learned them to a high B low C level, but they've since faded from memory. Trying to learn from language resources is painfully slow. Trying to watch TV or listens to podcasts is ineffectively difficult. I'm building Phrasing[1] to tackle just this problem. We've just launched with all of the base functionality[2], including automatic analysis of native material to surface the most important words, phrases, and quotes specific to that material. We then make it dead simple to create flashcards-on-steroids which will automatically be applicable as flip cards, cloze cards, audio cards, and more. When it comes to SRS, we: - use our own fork of FSRS coincidentally (that's why I'm here hey ) - do away with scheduled due dates and actually try to keep the user engaged at a specific difficulty (you'll only see hard cards if you're doing well and 'can afford' it, you'll see easier cards if you're not doing well) - dose out new reviews constantly, as it's better to make forward progress then to bang your head against all those challenging reviews We just onboarded our second cohort of users, but we're planning to onboard another cohort at the end of this month. If you're interested you can fill out the beta application [1] https://phrasing.app/ https://phrasing.app/ [2] https://blog.phrasing.app/phrasing-first-look https://blog.phrasing.app/phrasing-first-look

rpb92 3y ago

You've inspired me to rethink my approach to Anki. I've used it on and off for the last few years, but always fall in the trap of creating cards that were too convoluted. Sounds like I could benefit from some deliberate "laziness". Did you ever feel like you were answering correctly, on close cards specifically, not because of an improved understanding but because you were associating the correct answer with the prompt/excerpt? Would appreciate any advice on how to avoid this!

ekidd 3y ago
> Did you ever feel like you were answering correctly, on close cards specifically, not because of an improved understanding but because you were associating the correct answer with the prompt/excerpt? I actually suspect that associating the word with the context helps, as surprising as that might be. Let's say I grab a few sentences from an interesting article, and I boldface a word. I'll mark the card as "pass" if I at least sort of understand it in context. On day 1, I honestly might find the word fairly confusing. I can explain what it means, but maybe the grammar is unfamiliar. Ditto for the first few reviews. But then around day 8 or so, the card disappears until day 20 or 30. And the next time I see that card, suddenly the odd bit of grammar is completely natural and obvious. There's maybe some kind of medium-term memory consolidation mechanism occurring? Something happens when I'm not looking at it. Seeing the word in context somehow allows my brain to grab on. The human brain contains some incredibly powerful language learning machinery. In adults, that machinery still exists. Even if it's a bit rusty. And that machinery seems to work best on semi-comprehensible speech in a natural context. So think of Anki less as a set of facts you must learn, and more as a tool to distill and concentrate natural language so that you can let your brain work on your weak points. (And as soon as possible, start reading lots of books and watching TV! I learned the hardest 10% of my vocabulary using Anki, and much of the rest from context reading books.) Also, I find it fascinating that LLMs are trained using a very similar process. Either "predict the next word" or "fill in the blank". Now, they need a lot more input than any human does, but the fact that fill-in-the-blanks works so well in both cases is fascinating. Here are two of the most interesting experiments I tried with Anki: http://www.randomhacks.net/substudy/ http://www.randomhacks.net/substudy/ https://blog.beeminder.com/hieroglyphs/ https://blog.beeminder.com/hieroglyphs/ (The only language I ever bothered to push to a high level was French. Spanish and ancient Egyptian were basically experiments to see how quickly I could pick up the basics, using the tricks I learned while working on French. A language that you can use at a professional level is a bit like a pet; it requires ongoing care.)

jacquesm 3y ago

You have absolutely nailed it. Anki should work as a sliding window on material that you wish to learn not as an ever increasing bucket with more and more stuff in it. That way the new material will always be underexposed. It's much better to keep moving. I have the exact same patterns with learning pieces to play on the piano, and within those pieces you see those patterns again (it's almost a fractal).

fudged71 3y ago

Love this idea! Does Anki or any of its plugins support creating a difficulty progression when creating cards? ie. half-word cloze, then full-word, then multiple choice, then q&a, etc. I’m not sure how this would work in practice. Like would the next difficulty card be added to the deck once the easier card has reached a threshold?

cdwhite 3y ago
In relatively recent versions of Anki, you can create nested Cloze deletions: "{{c3::{{c1::foo}}{{c2::bar}}}}" will show you cards "[...]bar", "foo[...]", and "[...]", in that order, all with answers "foobar". As for multiple choice and q&a---my practice is to make both Cloze and basic cards for, well, most things---Cloze are good for the early steps and for seeing how different pieces fit together, but basic cards are more demanding, and without them I don't quite feel like I've learned a thing. (FWIW my primary use is physics & the mathematics behind it, not language learning.)

bluquark 3y ago

For what it's worth I've gone the opposite direction (one language, 70k Anki reps). For me, carefully adding context has largely felt like time wasted at card creation time (which can a surprisingly large proportion of study time per card, given how brisk reviewing usually is) and I've been bothering with it less and less. The default simple cards my dictionary plugin creates are usually good enough for me. I go out of my way to add context on the front of the card now mostly when it's a specialized word almost always seen within that context (so there's zero added value in learning it independently). I do agree with the general idea that laziness and going easy on yourself is good though. I give myself quite a lot of slack when grading my answers, applying a "my understanding of this word is close enough to avoid confusion in practice" threshold rather than some impractical ideal of native-level mastery.

ekidd 3y ago
> For me, carefully adding context has largely felt like time wasted at card creation time I actually had several custom tools that heavily automated card creation—I could grab a sentence from a web page, or bulk import highlighted phrases from an ebook. Then I had a UI which allowed me to easily highlight an interesting word, and either cloze it, or add a Wiktionary definition on the back. Then I had an Anki plugin to bulk import the cards. This could all obviously be combined into a single tool, and occasionally someone tries. For my most heavily automated experiment, I used a tool similar to subs2srs to import sound, bilingual subtitles, and tiny screen captures from 4 episodes of Avatar: The Last Airbender. That was a fascinating experience, and I'm still earwormed with the dialogue of those episodes a decade later, after only a couple of months of Anki reviews. (See elsewhere in this thread for a link.) Unfortunately, I'm not convinced that there's a good startup market for language-learning tools. Language learning is normally aspirational, much like a gym membership. And customers don't have any serious plans on how to reach their stated goals. (Again, like a gym membership.) Duolingo isn't terrible, but I suspect—based on lots of Anki experiments—that it should be possible to build much more effective tools than Duolingo. I'm just not convinced that anyone but serious ESL students would pay for them. Too many genuinely good tools in this space have sunken quietly, despite a user-friendly UI and a good landing page.

steve1977 3y ago

> One massively overlooked way to improve spaced repetition is to make easier cards. At least with SuperMemo, this is actually one of their main tips. See also: https://supermemo.guru/wiki/20_rules_of_knowledge_formulation https://supermemo.guru/wiki/20_rules_of_knowledge_formulatio...

dataangel 3y ago

Huh, hiding part of a word is brilliant. I never thought to do that even though I made tons of cloze cards.

huimang 3y ago

What killed Anki for me was having to add cards. It is such a chore adding single word cards. I also ran into the problem of increasingly niche synonyms that I'd learn, but would rarely see in text. For some reason I never really considered cloze cards. The anki default of 8 relapses before suspending a card is much too high. It took me a while to realize, but dealing with problematic cards takes up -way- more energy than learning new cards... it's not energy/time efficient at all. Do you have any recommended sources on cloze style cards? [45k reps here for Korean]

jamager 3y ago

> I don't think that biggest improvements will come from better spaced repetition algorithms Exactly that, specially for language learning. The stated goal of hitting a target probability is pointless IMO. Language acquisition is not about memorizing words, but progressive familiarization (eg via retrieval practice). You have to expose yourself to massive amounts of language, create your own cards fast, review them faster, move on even if you "fail", don't do too many repetitions (6-8 should be enough for >95% of cards) The most important aspect of an SRS algorithm is to be practical: sensible choices, equally spaced out among them, that allow you to decrease / maintain / increase intervals without ever punishing you for failing.

neves 3y ago

The original SuperMemo 20 rules for creating SRS cards are a treasure trove: https://www.supermemo.com/en/blog/twenty-rules-of-formulating-knowledge https://www.supermemo.com/en/blog/twenty-rules-of-formulatin... It will improve a lot your cards

callistus 3y ago

I've found Andy Matuschak's essay, _How to write good prompts_ [1] very helpful in making more impactful cards. https://andymatuschak.org/prompts/ https://andymatuschak.org/prompts/

deleted 3y ago
[deleted]
AlchemistCamp 3y ago
What were the key insights or surprises you got from that 13,000 word piece? For background, I contributed to Anki long ago, wrote regularly about SRS in the late 2000s and got deeply into them for language learning for a few years. Later, I mostly stopped using them since I found extensive reading both more interesting and a better return on my time. I’m interested in the topic but am not new to it.

laurieg 3y ago

You're doing SRS right! Geeks like us love to get into SRS algorithms and chase after the 1% improvements with a cleverer repetition algorithm or a better input method. The real failure mode is much more mundane: People give up. I see it all the time. People cram thousands of cards into Anki in their first month learning something. After a month or two they are so overwhelmed with reviews and the reviews become such a chore that they just give up. (Of course, there are people who manage to add thousands of cards every month for years and years. These are the people who would probably do nearly as well with just a pen and paper. ) Two pieces of advice that make all the difference: Make your cards a little bit 'too' easy and be rather selective with your cards. When you first make a card you're probably actively studying the subject of the card. You're very familiar with it and it's all in your head right now. The temptation is to make a card that is fun and challenging for you right now. Resist! Instead, make a card that feels slightly too easy, so that in a week or two it will be enough to tickle your memory rather than confuse you. Also, people dump entire books worth of sentences into Anki. I like to use the metaphor of walking through an orchard: take your time, look around and grab one or two of the nicest apples you find. If you try to grab everything you're only going to slow yourself down. Also, if you pick up a rotten apple (uninteresting/too difficult card) it pollutes your entire deck. You start to resist review your flashcards.

cratermoon 3y ago
Is there really any solid research determining the "best" algorithm, or even ranking them? As best I can tell, any process to repeat wrong answers more often and the correct answers less often, and does so with some amount of increasing time delta, will work. But I have yet to see any proof that one algorithm is better than another.
- bryanrasmussen 3y ago
  I mean this any process that you suggest is a set of algorithms. It would seem logically strange to suggest that when a method is not within the set of algorithms it will not work, but as soon as any method is used that repeats "wrong answers more often and the correct answers less often, and does so with some amount of increasing time delta" it will work equally well with other methods. I would suspect if this does appear to be the case that there probably is an optimal algorithm to start with but that all methods chosen here decrease in utility if you stay with the same variables (repetition frequency of wrong answers, repetition frequency of correct answers, time delta) for too long, the same way there are beneficial exercise methods for getting specific results when starting out that need to be varied if you want to keep getting results in that area without a decrease in the quality of the results.

jarrett-ye 3y ago

Yeah. I'm the author of FSRS and I agree with you. In my opinion, the quality of cards determines the upper limit and the algorithm just helps you achieve the upper limit efficiently.

kqr 3y ago

This is right. I tried and gave up on spaced repetition a few years ago. When I tried again a year ago and did more research, I realised my problem on the first attempt was that I made too complicated cards. I went back and dug up some of my more valuable cards from my last attempt, and some of them were so complicated that I had to break them up into 10–15 cards now that I know how to design good cards. That said, I don't think the point is to make them easy. Since you want to aim for a 90-something percent success rate to get the most benefit out of it, too easy will make the going slower. The point is to make them atomic and that usually feels easy, even if you fail 10 % of recall tests.

barrell 3y ago

We've got pretty similar ideas on SRS. I'm working on Phrasing.app, we use (a heavily modified version of) FSRS and have implemented a lot of what you're talking about. We just had a company retreat where we talked about new review modalities and several of these ideas came up. If it looks at all interesting to you [1], I'd love to chat more and hear more about your experience / approach / etc. Feel free to reach out at ben [at] phrasing [dot] app [1] https://blog.phrasing.app/phrasing-first-look/ https://blog.phrasing.app/phrasing-first-look/

vjk800 3y ago

Someone could make an NLP algorithm to determine whether a given card is well made. Training data could just deleted/non-deleted cards from a power users such as you.