8 ms·
The paper is interesting because they calculate the theoretically optimal difficulty for a specific class of learning algorithms: https://dx.doi.org/10.1038/s41
by yorwba 7y ago
The paper is interesting because they calculate the theoretically optimal difficulty for a specific class of learning algorithms: https://dx.doi.org/10.1038/s41467-019-12552-4 https://dx.doi.org/10.1038/s41467-019-12552-4 (I think the method might be applicable for scheduling flashcards better than the rule-of-thumb spacing of Anki et al.)
The Independent article is unfounded speculation about this applying to the way humans learn, without any discussion of whether the model is actually applicable. (Most things humans are trying to learn aren't binary classification tasks.)
- Mathnerd314 7y agoThe paper has the Law & Gold model of (monkey) perceptual learning as one of their cases, and has a bit of discussion about how stochastic gradient descent in ML is quantitatively similar to observed characteristics of human learning. I don't think it's unfounded speculation, except perhaps on the part of the paper.
- Mirioron 7y agoWhile human learning might be similar, is it similar enough? Humans seem to require very few data points to learn something. Just a few examples are enough for a human to grasp a pattern. As far as I know, we haven't been able to do the same in ML.
- sjy 7y agoI’m not so sure about that. Adult humans can learn new things with a remarkably small number of additional data points, but they’re drawing on a lifetime of human experience which is also data. Children tend to need more help.
- finebalance 7y agoRight. We have priors about how the world works, and that usually helps.
- conductr 7y agoML has training right?
- zadokshi 7y agoYes, Anki’s goal of “let’s quickly hide all the cards you know and only show you cards you are forgetting or on the edge of forgetting” has never seemed overly useful. The end result is the following algorithm: “let’s present you with the toughest things you can’t remember over and over again, and ignore all the facts you’ve done so well at learning (until you have almost, or completely, forgotten those facts)” Throwing up cards you can answer in 1 second is not wasting anyone’s time. It is more likely to be encouraging to people to remind people of what they know.
- echelon 7y agoIs there an easy adjustment to the algorithm parameters to make things better? Wanikani does an amazing job at SRS. I wish Anki followed its model.
- rajlego 7y agoI haven’t used either Anki not wanikani (I use SuperMemo) but from what I’ve heard wanikani has no leech management meaning you end up stuck repeating the kanji you keep failing, making the experience miserable. Leech management is really important for any decent SRS
- grep_name 7y agoCould you expand on this? I've used both but am not sure what you mean by leech management
- echelon 7y agoSometimes you'll have much more difficulty with certain items than others. No matter what you do, even after repeated attempts to learn, you just can't get them to stick. These are "leeches". They burn productive study and review time. I have a theory that these items have lower adjacency to past experience or knowledge and it's difficult to form mnemonics or other connections. Or they're less novel and don't cause our brain to take interest. That's where all of my leeches lie -- in the realm of things I don't particularly care about. A good leech management algorithm will back-burner unproductive items so you can focus on the rest of the concept population. There are different types of leeches too -- things you don't get during introduction, or things that you can commit to short term memory but won't stick for long. A good algorithm will identify all of them and block them.
- friendlybus 7y agoHumans have always thought or related the latest technology to their own functioning, particularly of the brain. It's amazing to see the process of people finding pistons and mechanical automatons as a metaphor for the mind. Then sequential programming and now ML. Humans have an incredible ability to restructure their own ideas about their brain with machines and adapt to new ideas, in a way that would break a machine. Not to mention the rest of human biology that contributes to our functioning minds outside of the brain. I don't know how to separate out the difference between learning something through immersion and seeing the broader world view that nestles those ideas within them.
- DoctorOetker 7y agoI agree the paper is very interesting Is there a mistake in equation 3? shouldn't it read: ER = integral (-inf, 0, p(h | ABS( Delta ), sigma ) dh ? for positive Delta I agree, but with negative delta either the integral should run from 0 to +inf, or the absolute value of Delta should be taken?