3 ms·
> We asked respondents to evaluate their own competence, for the specific work they do and years of experience they have, and almost 70% of respondents say they
by dahart 8y ago
> We asked respondents to evaluate their own competence, for the specific work they do and years of experience they have, and almost 70% of respondents say they are above average while less than 10% think they are below average. This is statistically unlikely with a sample of over 70,000 developers who answered this question, to put it mildly.
I’m seeing a lot of argument about statistics, and very little about the wording of this question.
It seems to me that by asking specifically for competence “for the specific work you do” means that everyone gets to define who they’re comparing against.
What this means is that it’s entirely statistically possible for 70% of people to be above average relative to whoever they choose their peers to be. I might compare myself to you, and you don’t compare yourself to me, so we can both be above average.
In order to argue about the math and statistics, the question needs to be well defined, and the group to which we’re talking about averages needs to be the same for everyone. This question, the way its worded, practically guarantees that the group someone compares themselves to is different for every single respondent.
- dahart 8y agoIt’s too late to edit, and maybe nobody will see this now, but I wanted to add that the particular question of competence and the majority result strongly reminds me about the story of the Air Force discovering that cockpits designed for the average human size were causing crashes because literally nobody is averaged sized. Discussed on HN before https://news.ycombinator.com/item?id=11230287 https://news.ycombinator.com/item?id=11230287 “Before he crunched his numbers, the consensus among his fellow air force researchers was that the vast majority of pilots would be within the average range on most dimensions. After all, these pilots had already been pre-selected because they appeared to be average sized. (If you were, say, six foot seven, you would never have been recruited in the first place.) The scientists also expected that a sizable number of pilots would be within the average range on all 10 dimensions. But even Daniels was stunned when he tabulated the actual number. “Zero. “Out of 4,063 pilots, not a single airman fit within the average range on all 10 dimensions. One pilot might have a longer-than-average arm length, but a shorter-than-average leg length. Another pilot might have a big chest but small hips. Even more astonishing, Daniels discovered that if you picked out just three of the ten dimensions of size — say, neck circumference, thigh circumference and wrist circumference — less than 3.5 per cent of pilots would be average sized on all three dimensions. Daniels’s findings were clear and incontrovertible. There was no such thing as an average pilot. If you’ve designed a cockpit to fit the average pilot, you’ve actually designed it to fit no one.” https://www.thestar.com/news/insight/2016/01/16/when-us-air-force-discovered-the-flaw-of-averages.html https://www.thestar.com/news/insight/2016/01/16/when-us-air-... So to go one step further and make a stronger statement, it’s not just possible for 70% of devs to be above average, it’s statistically likely for 100% of devs to be above average with respect to something they do, relative to some group. It’s so subjective that it’s meaningless, and we can’t really talk about the statistics.