5 ms·
Does anyone have any evidence, anecdotal or otherwise, that gamification is good for teaching STEM ideas in the long term? I am wary of rewarding the brain wit
by jessriedel 14y ago
Does anyone have any evidence, anecdotal or otherwise, that gamification is good for teaching STEM ideas in the long term? I am wary of rewarding the brain with in-game loot for memorizing the rules of algebra rather than with the deep satisfaction that comes with understanding. Obviously, this latter type of reward cannot be as consistently provided and requires a certain maturity (maybe), but ultimately I think it's what drives most insightful people.
Here's a good example of what bothers me:
>As the game progresses, you’ll start seeing cards that are above and below each other, with a bar in the middle — and you’ll learn to cancel these out by dragging one onto the other, which then turns into a one-dot. And you’ll learn that a one-dot vanishes when you drag it onto a card it’s attached to (with a little grey dot between them). These, of course, are fractions — multiplication and division — but you don’t need to know that to play the game, either.
That last sentence is especially telling.
To me, gamification is suited for making necessary but painful tasks fun (e.g. cleaning your desk, tagging media, memorizing facts), but not for deep learning (e.g. algebra, quantum mechanics, object-oriented programming). But maybe, at 26, I'm just not with the times.
EDIT: I think ColinWright is getting at the same worry, and his comment is more fleshed out http://news.ycombinator.com/item?id=4106567 http://news.ycombinator.com/item?id=4106567
- ezyang 14y agoBrett Victor writes: When most people speak of Math, what they have in mind is more its mechanism than its essence. This "Math" consists of assigning meaning to a set of symbols, blindly shuffling around these symbols according to arcane rules, and then interpreting a meaning from the shuffled result. The process is not unlike casting lots. This mechanism of math evolved for a reason: it was the most efficient means of modeling quantitative systems given the constraints of pencil and paper. Unfortunately, most people are not comfortable with bundling up meaning into abstract symbols and making them dance. Thus, the power of math beyond arithmetic is generally reserved for a clergy of scientists and engineers (many of whom struggle with symbolic abstractions more than they'll actually admit). I think gamification is a great way to teach symbol manipulation, and I think (contrary to Bret) that symbol manipulation is a prerequisite for deeper STEM ideas. I do also believe that harder mathematical problems can also be gamified, but this process is much less well understood, and you'll probably want a few theorem prover experts around if you attempt a system like that.
- dbaupp 14y agoI 100% agree that having symbol manipulation is required for deeper understanding and learning. In my experience, being able to quickly and (fairly) reliably move symbols around in one's head makes futher learning much easier and faster, as one can follow proofs and explanations intuitively without feeling the need to work through each step laboriously to justify it. As a simple example, being able to see the steps that were used to go between (x - 1)^2 - 2 = 0 x = 1 +- sqrt(2) at a glance gives one a higher "maths-learning" bandwidth, since one spends just the 3 seconds it takes to read those lines, instead of the extra 30 seconds physically doing the working. (And, on a slightly different note, having some basic facts memorised like (for example) "d/dx sin(x) = cos(x)" is a little like the difference between data in L1 cache and that just in RAM. However, this doesn't mean that one should not understand why, or not be able to rederive it in a flash by drawing a diagram or whatever.)
- jessriedel 14y ago> I think (contrary to Bret) that symbol manipulation is a prerequisite for deeper STEM ideas. Can you elaborate on this further? I tend to disagree, but I don't know if I have all that much to say to back it up. I mean, sure, there's just no good way to understand shear forces without being able to manipulate matrices (so I agree with dbaupp's sibling comment), but that doesn't mean you want to learn the rules of matrix algebra as if they were arbitrary rules enforced by the stick and carrots in a game.
- ezyang 14y agoIn the case of mathematics, there is a fundamental sense in which the symbols and their manipulations are what you're studying. Think of it as if you were an archeologist: the symbols are the artifact of study. It's only half of the picture: you must(!) come up with a different way of intuitively understanding it--but at the end of the day if you really want to precisely say what it is you're talking about, it's symbols.
- jessriedel 14y agoOK, I think I see what you're getting at. But we could devise a AltDragonBox game with a completely different set of arbitrary rules. (Possibly even rules that are inconsistent.) And as far as game play goes, AltDragonBox would work just as well. But there's a reason that the rules of algebra are what they are. And if you can't distinguish between DragonBox and AltDragonBox, I don't think you're learning what you need to learn. Here's another way to look at it: we all know people who could ace their high school math tests because they had memorized the rules of manipulation but weren't good at math--as evidenced by their poor performance in college and failure to succeed in future STEM classes. If "the symbols and their manipulations are what you're studying" (which, I agree, there is some truth to), then what is it exactly that these people were lacking?
- pacala 14y agodeep learning: abstract, apply mechanical rules, concretize
- archgoon 14y ago>rather than with the deep satisfaction that comes with understanding This may not be a problem. For me, that satisfaction happens when understanding makes the world make more sense, less arbitrary; like you just got let in a joke that's been puzzling you for years. This is just one more thing that will make sense later. If anything, it'll enhance the effect.
- learc83 14y agoI think gamification may not be able to directly teach a deep understanding. However, I think it may be able to encourage the development of a work ethic that will help to build a deep understanding.
- jessriedel 14y agoHmm. I worry that gamification does the opposite. Anecdotally, my exposure to a constantly available stream of shallow stimulation (reddit, etc.) has decreased my ability to stay focused on initially unrewarding tasks. This seems like an effect that could be captured with a controlled experiment, so I'd love to know if it's been investigated.
- dllthomas 14y agoI don't think deep learning is the starting point, for algebra; I think those who get it relatively quickly typically start from pattern recognition in applying the rules, and then the understanding grows beneath that. If that's the case, this kind of thing is fantastic. I could certainly be wrong, but either of us should start pointing at studies next...
- Lewisham 14y agoTo me, gamification is suited for making necessary but painful tasks fun (e.g. cleaning your desk, tagging media, memorizing facts), but not for deep learning (e.g. algebra, quantum mechanics, object-oriented programming). But maybe, at 26, I'm just not with the times. The thing to be careful about here is the use of "gameification". There's gameification of the Internet marketing bullshit variety, and there's making things more gameful. The suits ate up the first term and associated it with rewards, points and extrinsic motivation. The latter is a not-yet-bastardised term which simply means to try and find ways to make more tasks fun, to try to make systems explorable, malleable, and allow for failure. Games teach best when you're exploring systems and manipulating them, seeing what they do, manipulate them again, see the result of that. They're very refined incidental learning. What happens if you use bullshit gamification is the Overjustification Effect, where the rewards begin to dominate and crowd out the intrinsic motivation, as people begin to focus on those instead. Intrinsic motivation is your "deep satisfaction", and you are right that rewards erode it. This has been written about a lot by Alfie Kohn (eg. "Punished by Rewards"). I don't know of any research that shows that gameful styles of work, as long as they're not attached to large amounts of rewards, are bad at all. Having played with DragonBox a little bit this morning, it seems to do a very good job of being gameful, and extracting the game out of algebra. Some things I noticed: 1. The game really highlights the malleability of numbers. For me, this was the deep revelation about algebra, and it took me a long time to get there. The way the game is designed using touch, lets you fling numbers around and place them on top of each other and such, and doesn't let players get hung up on numbers or placement. We get to the understanding that algebra requires very quickly. You seem to see that as a loss, but I see that as a really big win. 2. As with all educational games, failure is easy and not punished. I haven't found a way for the game to show me solutions, but in a classroom setting, that wouldn't be a problem. 3. I don't find the rewards any more or less motivating than a checkmark next to my work, so I don't think we'll see the overjustification effect here. They just say whether you did it right or not. There's no achievement system that could encourage play that might be harmful to learning, just feedback on the specific problem you were solving. Feedback is required for students. Feedback is also a form of reward. So threading the needle is not easy, but it looks like DragonBox did a really good job here. All in all, I think it's a really good piece of work, and the developers deserve to make a fat chunk of change from it.
- zem 14y agoi think the salient point about dragonbox is not the reward system, it's the fact that the rules of algebra have been mapped, transparently and isomorphically, to the game rules. playing the game doesn't just help you memorise the rules of algebra, it actually makes you think about how you use those rules to manipulate and transform expressions, which is the fundamental skill underlying "real" algebra.
- kalid 14y agoI'm a big fan of intuitive learning and have mixed feelings too (downloading the game now to try it out). Some thoughts 1) Certain basics skills ("spelling and grammar") are needed to express/understand higher-level ideas (literature, poetry). Games help practice them. (Fear: gamification hurts internal motivation) 2) Fear: Assumption that "algebra-like" lessons automatically help algebra understanding. Does typing help piano playing? It's easy to assume both "use your fingers" and must correlate. 3) Fear: Reinforcement that math is about moving symbols around. We're trying to express ideas, symbols are their serialization. There's a "rule" that the same card must be added to both sides. We know it's to balance the equation. Does the kid know? What if the rule was to add the card twice to one side, and 0 times to the other? Why does one rule but not the other make sense? I'm excited that this helps practice basic skills, but am afraid of ending up with a Chinese-room situation where we can manipulate symbols but intuit nothing. We already have hordes of calculus "graduates" who vaguely remember "x^n... drop the n, make the exponent n-1"... and what of it? Did it shift their perspective? Update: After thinking more, I think the game is a good thing overall. For a young child (5, etc.) this game is giving them a new mental model of the world. Later on, when they learn arithmetic, and so on, it can be shown how this mental model corresponds to the rules. Giving children new analogies to work with is a good thing.
- dxbydt 14y agoOne of the more popular TV channels in India, especially during the exams, is Topper ( http://www.yupptv.com/topper_tv_live.html http://www.yupptv.com/topper_tv_live.html ) The channel has its share of teaching, but mostly its crude gameification. Very effective channel. In terms of viewership during the exam season( totally unfair given India's huge student population ), it would easily surpass your CNN or Fox or whatever it is that Americans watch. I watch a fair deal of Topper ( very addictive channel ). So they "teach" determinants by rapidly flashing square matrices on the screen and the competing student groups have to guess the value of the determinant. Not by computing adjoints and cofactors - that would be painfully slow. Mostly you use properties of determinants (http://en.wikipedia.org/wiki/Determinant#Properties_of_the_determinant http://en.wikipedia.org/wiki/Determinant#Properties_of_the_d... ). So if its a 3 by 3 and say a column is 3,1,4 and another column is 9,3,12, you know the value is zero ( because you could factor out the scalar multiple 3 and then two columns become identical, ergo value zero ). Sometimes they'll flash a triangular matrix and all you have to do is multiply along the diagonals. Or you'd have row 1 = [4,1,2], row 2 = [5,3,5], row 3 = [1,2,3]. Some smartypants would correctly guess that row 2 was just the sum of the other two rows, so the determinant must be zero. Is this sort of thing "useful" ? I don't know. But this is how I learnt much of my math in India...and they continue to use these games to this day. I can look at equations of lines & tell you if they slope up or down. I can tell you whether your parabola is convex or concave, where the focii are and what the lengths of the minor and major axis of your ellipse will be....tons and tons of repititive trivia, force-fed through pattern matching & gamification. Just by looking, no actual calculations! But this is one of the reasons Indian grad students tend to do well out here in STEM...we have no intuition but tons of gameified training. Once we are here, we'll get the intuition as well. To start with intuition would be a horrible idea, because the teacher quality back home is horible. Most of them honestly have no idea what a vector is or a complex number is...in most cases English is not our native tongue, so we can't even pronounce "surd" correctly, let alone know where it came from, but we all know that the root of 3 is a surd and its root isn't a surd and so on ( my math text: http://books.google.com/books?id=1C4iQNUWLBwC&lpg=PA25&pg=PA26#v=onepage&q&f=false http://books.google.com/books?id=1C4iQNUWLBwC&lpg=PA25&#... ) imho, gamefication is unequivocally good in STEM, atleast upto college math level. Ultimately its all symbol pushing.
- dkarl 14y agoTo me, gamification is suited for making necessary but painful tasks fun (e.g. cleaning your desk, tagging media, memorizing facts), but not for deep learning (e.g. algebra, quantum mechanics, object-oriented programming). We tend to think of understanding as "deep" and competence as "shallow." We tend to think of solving a problem for the first time as the valuable part of learning, and solving similar problems over and over as a waste of time. Maybe we even see it as stultifying, or as cheapening the experience of learning. Yet practice deepens understanding, and even if you don't believe that, you have to admit there's a long way to go between "understanding" algebra in the intellectual sense and mastering algebra in the mindless way that lets you use algebra when your mind is busy doing something else, such as learning chemistry or geometry. Anything that makes practice a little bit less boring will help kids develop fluency so they aren't distracted by understanding algebraic manipulations when they're supposed to be thinking about something else and just doing the algebra.
- twelvechairs 14y agoI think you are being a little narrow-minded in basically saying that your own 'deep satisfaction' in 'deep learning' is the single-goal of maths. To me, there are many sides of maths, and different people know, utilise and enjoy these in different ways. If this tool provides a new 'in' I'm all for it - though of course its not going to teach everything, and its not going to be right for everyone (nothing is - even the best maths lessons). Also - its aimed at non-maths time (ie. replacing 'angry birds') rather than competing for with other learning time (I wouldn't be so happy if they for instance started making things like this mandatory in school). So really I don't see where the loss is....
- apu 14y agoYes, there is growing evidence that gamification, if done right, can be really good for teaching ideas. Zoran Popović [1], a faculty member here at the University of Washington, has been working on these issues for a few years now with his "Center for Game Science" [2]. And at a more advanced level, games like FoldIt [3] are starting to make small dents in difficult problems like protein folding. [1] http://www.cs.washington.edu/homes/zoran/ http://www.cs.washington.edu/homes/zoran/ [2] http://centerforgamescience.com/ http://centerforgamescience.com/ [3] http://fold.it/portal/ http://fold.it/portal/