8 ms·
What the Dunning-Kruger effect is and isn’t (2010)
- mewpmewp2 6y agoI think one of the key takeaways was that people are biased or wishful to think that Dunning Kruger effect is stronger than it really is because people want methods to shut down anyone who brags or thinks very highly of themselves
- dgb23 6y agoAlso you cannot deduce from "person thinks they are skilled" to "person is not skilled". But it is useful to think about this for our personal growth. There are many psychological traps and challenges that can slow down progress or even halt it. Related: https://daedtech.com/how-developers-stop-learning-rise-of-the-expert-beginner/ https://daedtech.com/how-developers-stop-learning-rise-of-th...
- PoignardAzur 6y agoYeah, I really strongly agree with that point. Every single time I see the Duning Kruger effect quoted it's used to dunk on some person perceived as incompetent (usually a highly-placed executive) as a way to say "No, look, all people in that position think they're geniuses but they're actually morons!" But... well, even if there weren't a thousand different possible confounders (regression to the mean, of plain confusion about the level of competence of the other students taking the test), the DK effect isn't that strong. People act like it's an uncanny valley of stupidity and hubris, when as presented it's more like perceived competence is only roughly correlated with actual competence, with minor bumps. And yet people keep invoking it as if it were the explanation behind all the incompetence in the world.
- baron816 6y agoThe way I interpret DKE is that low level people don’t (yet) know what they don’t know. One thing that I think often gets skipped over in discussions on Imposter Syndrome is that imposters DO exist (that’s kind of why we use interviews when hiring people).
- karmakaze 6y agoYes, the wikipedia quote seems incomplete "The miscalibration of the incompetent stems from an error about the self, [...]" The source of miscalibration is from the estimation of the subject area and the assessment of how much of that has been learned. I suspect that the error in the estimation of the subject space is the much larger source of error.
- xyzelement 6y ago>> The way I interpret DKE is that low level people don’t (yet) know what they don’t know. Exactly, it's like people who think the company CEO is a useless idiot because they don't see him writing React code or whatever their limited definition of "adding value" is. Another example I see on HN - whenever a hiring thread comes up, people chime in how stupid whiteboard interviews are, and surely the poster would be a super-star at a FAANG if only they weren't gate-kept by these dumb interviews. Isn't it more likely that these super-successful companies use these interviews because they end up hiring the people they want to hire, and it's you, the poster, lacking a clue as to what that looks like? Basically the heuristic is, if something/someone is successful and it seems stupid to you, start by assuming it's you who likely has something to learn.
- rozularen 6y agoYour last sentence made me think about Hanlon's Razor[0] [0] https://en.m.wikipedia.org/wiki/Hanlon%27s_razor https://en.m.wikipedia.org/wiki/Hanlon%27s_razor
- Moodles 6y ago> Isn't it more likely that these super-successful companies use these interviews because they end up hiring the people they want to hire...? I’m not sure it’s that these companies only hire the people they want to hire. It’s probably that highly successful companies know their interview methods don’t work 100% of the time, but they’re willing to tolerate the false negatives of not hiring a few good people if it means all those they do hire meet some minimum standards. And their current system is the best they know how to do. We arrogantly post on Hacker News: “Oh look, this interview method sucks! It will miss out on this great candidate!”. Ok then, make your own trillion dollar company with a better interview method that filters out the hordes of bullshit artists while simultaneously never missing out on the best people. Filtering out the bullshit artists is more important than hiring every single productive person. In fact, if you hire too many bullshit artists, all the good people will get fed up and leave anyway.
- banjomet 6y agoWhat do you call it when you mistake "I know OF x" for "I understand X". I used to do it all the time; I think that because I have heard of something, I somehow know how it works or how to use it. For me, it's kind of like going "Oh, I've seen that meme before!" and somehow going meme++ in your head, so of course I am 'more familiar with it', but I am doing that for advanced topics I have no demonstrated practice in. I am much better now at realizing my incompetence, but I wish it could be studied in more detail, instead of people just looking at someone who is demonstrating confident incompetence and going "Dunning-Kruger?" "Dunning-Kruger!".
- xallarap 6y agoCorrelation does not imply causation. Regression to the mean and other statistical artifacts haven't, afaik, been proven to explain any part of the dunning kruger effect. This is, like the article, of course, speculation.
- gwern 6y agoYes they have. You get D-K exactly when you run the simulation of the data collection with ceiling/floors, and you have to for basic statistical reasons. There's nothing to explain. D-K does not exist, and OP is misleading in trying to 'correctly' explain research that was wrong to begin with (he gets only halfway there when he admits that regression to the mean forces much of D-K, but then handwaves furiously that it can't explain all of it, when the other measurement problems account for the asymmetry in how much the top/bottom groups regressed).
- alisonkisk 6y ago> when the other measurement problems account for the asymmetry Such as? And what about the 2nd and and 3rd quartiles? And even if the phenomenon is caused by the mathematics of floor/ceiling effect (low skill people bias their assessment upward because they know they can't have a negative percentile), it's still real effect in misestimating their percentile. Baseball players at bar can be modelled by random numbers too. That doesn't mean variance in performance over time is purely random.
- Digit-Al 6y agoI think this article needs to be tagged that it's from 2010.
- dang 6y agoAdded. Thanks!
- lurquer 6y agoThose who claim they understand the Dunning-Kruger effect are typically less competent than those who don’t.
- gregmac 6y agoOne application I don't see discussed much is how this is useful for personal learning. Knowing the effect exists is useful when learning about a totally new topic: you know you need to hit that first peak, so to speak, to figure out (roughly) the scope of what there is to know. This helps avoid actually having that false confidence early on. One of the most memorable examples of this for me was early on doing calculus in high school. There was a time where I was like "ok, yeah, I understand all the maths stuff now," then I hit that first peak and suddenly realized "oh wow, I know only a tiny, tiny fraction of what there is to know!" When I later learned about Dunning-Kruger it resonated because it described what I had experienced years earlier and had being thinking about since.
- colomon 6y agoFor me the big eye-opener was learning to play traditional Irish dance music on whistle. About two years into the process, I thought I was great. I could read sheet music, I could play fast, I could play rolls, I knew a couple hundred tunes! Clearly I had to just keep it up at the same rate a few more years and I'd be a master. And then, about two years after that, it gradually sunk in that I'd been missing everything about what the music was really about. I hadn't been able to pick out what made good playing good, so I couldn't tell that my playing wasn't. I had been focusing on a bunch of superficial stuff and missing the heart of the thing. And now 20+ years on, I am vastly better at it than I was when I thought I was great. But I know there are loads of people much better. And I'm constantly worried there's some other epiphany waiting to happen when I will realize I'm still missing something absolutely key...
- DINKDINK 6y agoThe most aggravating aspect of the Dunning-Kruger effect occurs in people who know about the Dunning-Kruger effect: often they believe there can be _no_ case where the bulk of a distribution is above average. The easy example is: The average number of legs on a human is "1.98", the bulk of the population is indeed above average.
- whatshisface 6y agoThat's why I say "above median." (50% is above median by definition).
- JamesBarney 6y agoWhat was really enlightening for me was that DKE is really just plotting two lines, perceived ability and actual ability. Now if people were perfectly accurate those lines would be drawn on top of each other. But because either people underestimate their differences or correctly guess their true ability which the test doesn't full capture. Let's make the perceived ability line flatter. People tend to overestimate their own ability, so we should move the perceived ability line up which leads to an intersection on the right. Causing us to find that the best performers are the most accurate, explaining DKE. But the harder we make a task the more we push that perceived ability line down. And if we make a task sufficiently hard then the worst performers are the most accurate judge of their own ability showing the opposite of DKE, due to the intersection being pushed left. So really DKE is an artifact.
- philwelch 6y agoImagine a graph where the x-axis is competence and the y-axis is self-perceived competence. Quadrant II of that graph is Dunning-Kruger. Quadrant IV is imposter syndrome. Quadrants I and III aren’t talked about but I suspect most people, most of the time, end up in these quadrants if you ask them about their ability to repair helicopter engines or perform open-heart surgery.
- alisonkisk 6y ago"Almost no one can perform open heart surgery well" and "I am better then the average person at open heart surgery" are fully consistent personal opinions one could have.
- alisonkisk 6y agoWhy so? > But the harder we make a task the more we push that perceived ability line down. That's only true if people misperceive how hard the task is across the population. Or if the measurement is trivialized because the distribution of actual performance is ovwrwhelemedr by noise.
- JamesBarney 6y ago
- dang 6y agoIf curious see also 2015 https://news.ycombinator.com/item?id=10145480 https://news.ycombinator.com/item?id=10145480 Discussed at the time: https://news.ycombinator.com/item?id=1498136 https://news.ycombinator.com/item?id=1498136 Related from yesterday: https://news.ycombinator.com/item?id=25546787 https://news.ycombinator.com/item?id=25546787
- mannykannot 6y agoIn setting out Dunning's & Kruger's own explanation of the data (incompetent people lack the skills they’d need in order to know they’re incompetent), the author asks, rhetorically, "If you don’t understand very many words in another language, how can you evaluate the size of your own vocabulary in relation to other people’s?" Well, as in my case, if you know many words in your native tongue that you cannot express in another language, surely that's a clue available to anyone in the same situation?
- codeflo 6y agoTrue, but it’s not perfect. Learners of English often don’t realize that they’re missing certain distinctions that their native language doesn’t make. Pig/pork is a common example. English has a lot of those.
- mannykannot 6y agoPoint taken. It has reminded me of a somewhat infamous phrasebook where, IIRC, the author simply applied a translation dictionary to phrases in his native tongue, without regard to these subtleties, or even of differences in grammar.
- jwilk 6y agohttps://en.wikipedia.org/wiki/English_as_She_Is_Spoke https://en.wikipedia.org/wiki/English_as_She_Is_Spoke
- austincheney 6y agoOne possible explanation for why the DKE is biased towards incompetence is any bias that derives from favorably redefining a problem. Over achievers don’t need to redefine a problem set to more narrowly qualify their performance. For example an expert JavaScript developer can quickly produce an MVP with an original code solution. A less competent (confident) developer might also be able to produce a similar MVP but only in certain contexts, such as requiring a particular framework. The less competent developer may refer to themselves as an expert developer in React, or whatever other framework, but in doing so redefines the problem to fit a more narrow context not immediately aligned to the product.
- BrandoElFollito 6y agoThe thing I find sad is that there are people who realized that they are a mismatch for their position, not always because it is too high but sometimes because it is on the wrong track. Making the change is usually very difficult, as companies do not see "demotion by the demoted" as something normal. A case I witnessed was a VP of Engineering who realized (after many years at that position, performing well) that he is more an engineer than a manager. His results were good but he did not like the work he was doing because his true talents were under-utilized. He wanted to move to a position where he would have a more "technical" role, on the official "technical ladder" but it was very difficult for him to make his point. He liked the company very much though (in Europe). I did not know what to really tell him at the time, I wish I had some good arguments for him to help his case. One of the key things is that he did not want to change the company - he loved it, he loved what they did; he just took the wrong turn at some point.
- forrestthewoods 6y agoThese days I associate “Dunning-Kruger” with “humblebrag”. I have similar feelings about Imposter Syndrome. I wish both terms had never been popularized.
- rubyn00bie 6y agoI personally think the DKE is more likely to be found in knowledge based tasks requiring some level of gatekeeping. Like programming for example... It has been quite a while now ~9 years, but I had the chance to work at a pretty prominent tech company for about 8 months when it was roughly 13 people in engineering. It was my first job experience in "tech" proper; and I think, I was most fortunate, to have had the opportunity. Immediately, and without question, I knew for sure I was absolutely the most junior person there. It's not because anyone was unkind, quite the opposite; everyone else was so unbelievably experienced it was obvious. I had, up until that point, not encountered such levels of professional experience, or expertise in a field, outside of university. It gave me perspective for my (own lack of) ability I likely could not have gotten otherwise. It was humbling in a wonderful way because it meant I had, and have, a great deal to learn. I was happy to be resolutely at the bottom. While undeniably good for my person, and who I want to be in life, it has also come to cause me a lot of pain. Having worked pretty tirelessly since that original job, in the pursuit of learning and mastery of my craft. And if I am honest, to my chagrin, found I now underestimate my abilities. I only realized this because I generally give people the "benefit of the doubt" and it kept/keeps (still trying) biting me. It's very much insanity: doing the same thing again, knowing it won't work, expecting a different result... "'cuz someone else must be smarter than me." What I should learn to say instead of "smarter than me" is "less experienced and very confident." Erik Dietrich wrote an article about the Dunning-Kruger where he coined the terms "Advanced Beginners" or "Expert Beginners." Like Dietrich, I tend to observe these folks, have the capacity, to cause the most harm for people in the competent/proficient areas (like I find myself). I believe they mean well, in most cases, but disregard anything not directly from an expert. The worst case being there is no expert available to help check them, and they will unrelentingly default to themselves. A close second, when they are the gatekeeper to the expert, and are unlikely or unable to explain someone else's ideas. It's easy to see why it happens though. Unable to scope problems/tasks correctly; the problem's resolution becomes rooted in "beliefs," and generally speakings, people view other's beliefs as equivalent. With equivalent choices, we tend to then make decisions based on our preferences. ... but I digress, I've ranted and rambled enough. [1] - Link to the referenced article: https://daedtech.com/how-developers-stop-learning-rise-of-the-expert-beginner/ https://daedtech.com/how-developers-stop-learning-rise-of-th...