12 ms·
When the U.S. air force discovered the flaw of averages
- deleted 11y ago[deleted]
- banku_brougham 11y agoThe concept of no members of a group fitting into the average range for all observations is reminiscent of the 'curse of dimensionality'. Can anyone with a data science background make the connection here? Secondly, this seems to explain why everyone hates autocorrect.
- TTPrograms 11y agoYeah, in this case if the 10 traits are independent and the chance of falling in the "average range" is 1/3 for any one trait then the probability of any one soldier falling the the average range for 10 traits is (1/3)^10 = 1/59049.
- ziedaniel1 11y agoThat's assuming that they're independent, though, which is certainly false. I'm curious by how much.
- harywilke 11y agoWhy is it certainly false?
- danbruc 11y agoThe simplest example I can come up with is the weight - the density of humans is probably constant for practical purposes and therefore the weight must be positively correlated with your body dimensions. It is also pretty obvious that humans, or tissue for the matter, does not grow in a strongly directional manner. If you gain weight more or less all dimensions not constraint by your skeleton will increase, i.e. you will probably not end up with a wide but flat or narrow but thick belly.
- icodestuff 11y agoSure, but weight gain in adulthood doesn't cause you to get taller.
- danbruc 11y agoThat is way I said not constraint by your skeleton - or what ever else. The point is that at least some dimensions are obviously correlated, not that all dimensions have to be correlated.
- pbhjpbhj 11y ago>weight gain in adulthood doesn't cause you to get taller // Not even a tiny bit, like because of fat feet or more fat on the head? Not trying to be facetious, just seems huge people have fat feet and that there's likely to be a little fat on the bottom of the foot. Mind you that's going to be countered by compression of the spine, so there could be a inverse correlation?
- douche 11y agoI wouldn't say density is a constant. Muscle weighs more than fat for the same volume, as does bone. Same height, higher muscle or denser bone structure, and you can have wildly different weights. Makes simplistic measurements like BMI pretty laughable - look at pretty much any athlete, who would run high over-weight or obese according to BMI.
- danbruc 11y agoThat doesn't matter, humans are a lot of water and the density of humans seems - after a quick search - to be essentially within the density of water plus or minus ten percent. In this context that's constant enough for me and definitely way to small to possibly offset the variability in body weight.
- gefh 11y agoBut you might naturally assume a strong correlation between the middle range of each dimension - the interesting conclusion is that it's not nearly as strong as our intuition suggests.
- danbruc 11y agoBut even if they are correlated that does not necessarily imply that being average on one dimension makes it likely to be average on other dimensions. I can well imagine that correlations conspire against you, i.e. that being average in one dimension makes it likely to be non-average in another dimension.
- gefh 11y agoThat appears to be the case, but is counter-intuitive enough that it took the air force years to realize it.
- Gibbon1 11y agoI assume there are developmental genetics that apply to a whole organism. Everything on an elephant has to be big and everything on a mouse has to be small. But then there probably is little correlation between localized development genetics. The result is that within the 5% to 95% range the correlation between the size and shape of developmental features is pretty much zippo and simple non-correlated probability dominates.
- frankc 11y agoThat is true, but this can be just as much an issue in 1 dimension. Consider that the average person has roughly 1 testicle. I think it's about understanding distributions, and joint distributions are a big part of that.
- deleted 11y ago[deleted]
- Nimitz14 11y ago> The concept of no members of a group fitting into the average range for all observations is reminiscent of the 'curse of dimensionality'. Can anyone with a data science background make the connection here? ? It would seem like you have made the connection already. Although I don't see it.
- okintheory 11y agoYes, this can be made precise: For example, consider a uniform distribution on a d-dimensional cube with side length 1. Only a (1/2)^d fraction of the mass is within 0.25 distance of the average in every coordinate. In high dimensions, almost all the mass is "near the boundary" in at least one coordinate.
- carlob 11y agoOr as one of my professor would say (after showing the calculation for n-dimensional spheres): "and that's why infinite dimensional oranges are all skin!"
- kirrent 11y agoThis must be a common saying. I've heard it from every lecturer I've ever had for machine learning and sampling techniques.
- carlob 11y agoI suspect it comes from statistical physics, as it's a very common approximation when you're in the thermodynamical limit, which basically means that the phase space has a very large number of dimensions.
- mattkrause 11y agoIt's undoubtedly pithy. (sorry!)
- kazinator 11y agoLecturers get together in a staff room early in the morning and rehearse the delivery corny jokes in unison, the way teams of shop clerks in Japan go over phrases like "irasshaimase" and "omatase shimashita".
- contravariant 11y agoWeirdly enough, even the proportion of points within a distance of 1/2 to the midpoint becomes really small for higher dimensions.
- trollingineer 11y agoData science background here. Connection made. Anything else you want?
- lacker 11y agoIt doesn't have to be a high-dimensional space. 0% of a donut is near the average.
- brad0 11y agoIs it just me or does this sound oddly familiar to machine learning recommendation systems? ie: show an item based on the average of all the other items that everyone else has looked at.
- deleted 11y ago[deleted]
- casperc 11y agoYeah, I was thinking of the same thing. It's not my field professionally though, so I am not sure what the relevant conclusion would be for machine learning though (or if the comparison holds at all).
- BillinghamJ 11y agoI don't think that's quite correct. Recommendation engines normally work by taking the things you favor, then looking at who else favors those things, and deducting that you're all likely to have shared interests.
- masklinn 11y agoYeah I'd assume the simplest recommendation engines work on correlation. A recommendation engine working on average would be complete garbage, you'd be better off picking recommendation at random.
- yeukhon 11y agoQuote emcq's response above: > If you're thinking about the cold start problem when you dont have any information about a user, yes it's possible that your overall statistics is a combination of many subpopulations that doesn't really fit anyone very accurately but there are ways around this as well. I'd say a better approach (but may have user experience penalty) would don't even decide for the user, ASK. For example, take Flipboard / Quora as an example, you are asked to choose some topics to follow at the beginning. Assume research/data show 80% of the users are software engineers and 90% of them always pick "technology" as a topic they want to follow, would you rather show technology as one of the top five in the list of topics to choose? There's actually a lot of experiments you can do from a simple selection/survey process. I personally can't stand at going through pages to find something relevant, but I am also surprised to find things I never thought would be interesting to follow if I weren't present the options at all / or earlier.
- my5thaccount 11y agoArticles like this remind me how rational and practical the military is. I know so many brilliant military minds, yet war itself seems outdated and plagued by so many emotionally irrational decisions. I can't reconcile those two thoughts. How can people inside the military be so incredibly smart, yet still think it makes sense to ... you know, kill people's friends and families and not expect them to become terrorists. What am I missing? It can't just be greed. Military industrial complex. The military minds aren't smarter than that? I struggle with it.
- ccvannorman 11y agoMomentum. Also, it's easy to paint yourself as "the good guy with all the government sponsored guns and military contracts" who will "keep the other good people safe" because "you're better, smarter, more capable and more honorable than them." It's a very sexy and lucrative mindset, so it shouldn't be a surprise that it's pervasive.
- SixSigma 11y agoDo military people disagree with your analysis about killing ?
- my5thaccount 11y agoI was really dismayed when Colin Powell argued for invading Iraq. Yes, there are military people who get it. But just look what's happening. I guess they have to think, what is the alternative? We can't change our role in the Middle East. We can't just stop supporting Israel for example. I suppose yes, they tried Camp David. I guess I just want everyone to cease fire. Maybe the overpowered people resorting to terrorism, I do hate that word, have to think there is a positive outcome from the cease fire. If they cease firing and life doesn't improve, why did they cease firing? At least firing alleviates the frustration of it all. They think they are hurting those who are hurting themselves. But life for the Palestinians never improves no matter. It just keeps getting worse and worse and worse for them. The people with the power have to stop exerting it over others and selfishly taking more. I had a buddy in Afghanistan and he said their way of life is 500 years old. I mean, I think okay, if they don't want to progress, that doesn't mean we should use the tools of our progress to take from them so we can progress more. I think at some point we have to stop betraying people.
- DigitalJack 11y agoHas nobody heard of quetelet?
- my5thaccount 11y agoNo, but thanks for bringing him to my attention! It's amazing how someone like that so long ago could have such an impact on so many fields, while today, it takes teams of people to win the Nobel prize in a single field. It's a testament to how much we know today relative to yesterday.
- cJ0th 11y agoI think we had a discussion here on HN not long ago but I can't find it. edit: Found the article: http://www.theatlantic.com/business/archive/2016/02/the-invention-of-the-normal-person/463365/ http://www.theatlantic.com/business/archive/2016/02/the-inve... comments: https://news.ycombinator.com/item?id=11155889 https://news.ycombinator.com/item?id=11155889
- my5thaccount 11y agoThinking about this and the wisdom of crowds makes my brain feel fuzzy.
- trhway 11y agojoint distribution of 2 normal distributions isn't necessarily a normal distribution in 2 variables. Independence would be sufficient condition for that, yet obviously there is no independence between various measurements of a human body. https://en.wikipedia.org/wiki/Multivariate_normal_distribution#Joint_normality https://en.wikipedia.org/wiki/Multivariate_normal_distributi...
- deleted 11y ago[deleted]
- trollingineer 11y agoWhat are you talking about?
- chiph 11y agoI was thinking it was a Venn diagram, where none of the bubbles had complete intersection with the others. "This bubble represents all pilots between 5'6" and 5'11" in height. And here's the bubble that represents those with 40" chests. Note how they barely intersect."
- raverbashing 11y agoWhich is funny, because the problem seems to arise exactly because the variables are independent. If they were dependent then one could imagine all sizes correlate with height, for example .
- daodedickinson 11y agoIf the environment was homogenized enough this would no longer be an issue.
- tokenadult 11y agoWow! This has implications for human genetics (a study that originated partly in considering human body size measurements like those described in the article) that I think most popular writers on human genetics have not taken into account. There was an article posted to Hacker News earlier this week that suggested, surely falsely in my opinion, that human genomes can be optimized for intelligence to such a degree that we won't even be able to estimate IQ scores for future individuals with the same kind of tests that we use now. I rather doubt it. Because of pleiotropic effects of genes, almost surely there isn't a gene shuffle that will massively increase human intelligence, but rather just strategies (as likely to be environmental as genetic) to improve average intelligence within the range already found in the worldwide human population. Similarly, imputation of "race" by genome testing depends crucially on assuming that the average genome is informative, but for any trait of interest, a person who by both genome testing and known historical ancestry is categorized in some "race" category might have any degree of variance from "average" in the trait found in the whole human genome. It will be exciting to follow up on larger and larger data sets on these issues as human genomics projects continue.
- yummyfajitas 11y agoSimilarly, imputation of "race" by genome testing depends crucially on assuming that the average genome is informative, This is a nonsensical mischaracterization of both modern genetics and the theory of high dimensional vector spaces. The phenomenon the article is discussing is the fact that the mass near the center of a normal distribution approaches zero as the number of dimensions goes up, and that most of the mass lives a distance sqrt(N) from the origin. This does not imply that a) you can't have gaussians or other distributions which are separated from each other or b) that projections of one of these distributions can't have a different distribution than a projection from the other. Please go read Foundations of Data Science, chapters 1 and 2 before expounding on this topic further: http://research.microsoft.com/en-US/people/kannan/book-no-solutions-aug-21-2014.pdf http://research.microsoft.com/en-US/people/kannan/book-no-so... Can you clearly state what, precisely, you think this article proves about either classification, intelligence augmentation or group differences in specific traits?
- 11y ago
- j0e1 11y agoReminded me of “Be together. Not the same” ~Android :)
- wpietri 11y agoThe thing that strikes me here is how much we repeat the mistake of Norma (taking the mythical average body and assuming that differences mean problems) today in talking about people's minds. I started using computers before it was fashionable, before my fellow nerds started being worth billions and ending up on magazine covers. It's hard to describe now how much our difference was seen as wrong, as the sign of a problem. I have to wonder how much other natural differences gets medicalized. I know I have friends who take drugs for "insomnia" even though the only problem they experience is that they don't always get the "average" night of eight hours uninterrupted sleep. (Which anyhow is a modern invention. [1]) When I was in mourning after my mom died, a few buttinskys suggested I talk to my doctor about antidepressants, even though actual experts thought I was doing fine. And I worry about the number of schoolkids who have their differences medicalized because, in effect, they are inconvenient for overburdened teachers using industrial-age models of education. I have no solution here, but I definitely find it troubling. [1] For more, see this podcast, especially the "Til Morning is Nigh" segment: http://backstoryradio.org/shows/on-the-clock-4/ http://backstoryradio.org/shows/on-the-clock-4/
- Retric 11y agoModern psychology does not care about average it cares about capable of functioning in society. If you can't avoid say screaming in public that's a problem not just a non issue. Arguably the tolerances might be low, but it's hard to argue with the basic premise. Granted doctors assume if your talking to them you have a problem. But that's arguably a reasonable prior. PS: The extremes of behavior get very far out there, notmenjoying talking to people is fine, not being able to so communicate is an issue.
- coldtea 11y ago>If you can't avoid say screaming in public that's a problem not just a non issue. Arguably the tolerances might be low, but it's hard to argue with the basic premise. People are prescribed stuff for much much less than "screaming in public", including feeling stressed in BS high stress jobs, being "hyper-active" at school, etc -- with "modern psychology" more often than not siding with the normality of abnormal and abusive societal norms (as it always did. Science is conservative. Not so long ago you got medical treatment for being gay, for example). >Granted doctors assume if your talking to them you have a problem. But that's arguably a reasonable prior. Doctors also prescribe and over-prescribe all kinds of BS to people who don't need it, and get all kinds of pharma percs for doing so. Heck, they'll go even to doing un-needed operations, compared to that, prescribing BS is nothing: https://www.google.gr/search?q=uneeded+operations+scandal https://www.google.gr/search?q=uneeded+operations+scandal
- software_radio 11y agoCareful! The Obese will use this to try to justify the dangerous "Health At Every Size" movement which has been killing people.
- olalonde 11y agoThought this would be about http://www.johndcook.com/blog/2008/01/21/selection-bias-and-bombers/ http://www.johndcook.com/blog/2008/01/21/selection-bias-and-...
- bsbechtel 11y agoI'm pretty sure averages used in the wrong way affect many more fields than any of us can realize today.
- regularfry 11y agoThat's basically the entire premise behind the Black Swan meme.
- keenerd 11y agoWhile hindsight is 20:20, parts of this should have been more obvious. > Daniels generously defined as someone whose measurements were within the middle 30 per cent of the range of values > Daniels discovered that if you picked out just three of the ten dimensions of size ... less than 3.5 per cent of pilots would be average sized on all three dimensions. 30% raised to the third power is 2.7%. Basic probability. I guess everyone assumed there would be heavy clustering instead of largely independent variables?
- muddyrivers 11y agoThat is over-simplification. First, the samples are not randomly selected. The selection process tended to lean toward means, based on the article. Second, the variables are not independent. They are strongly correlated. The selection process indicated that the probability of having a pilot with long legs but short arms was close to zero.
- cowsandmilk 11y ago> They are strongly correlated Uh, no. What the study shows is that people assumed these measurements would be strongly correlated, but they were not. When only 3.5% of people fall into the middle 30% on 3 variables, that is strong evidence that they are mostly independent.
- sparky_z 11y agoAssuming a normal distribution instead of a uniform one isn't that outlandishly unreasonable.
- keenerd 11y agoHe didn't assume a normal distribution. It wasn't "within ±15% of the mean". It was "the middle 30% of the range". This means excluding 70% of the population for each factor, regardless of the distribution. Finding a "normal person" was impossible from the beginning with that approach.
- sandworm101 11y agoI don't see the problem. The fact that no person fit the model perfectly doesn't mean that the model was a poor choice. The question shouldn't be whether any customers fit the cockpit perfectly, but how many customers do and do not fit absolutely. You build the legroom so that most legs will fit, and headroom so that most heads will fit. Then as many people as possible shall fit. Everyone will have some dimension that isn't perfectly accommodated, but few should be rejected. The fact that nobody fits perfectly doesn't take away from a design that reasonably accommodates as many people as possible. A cockpit is not a suit. It's a communal chair/workspace meant to be used by various persons over many years. The metric of a good design should be how many/few people are so out of standards that they cannot work properly in the space. This is a perfect metaphor for hiring. Look only for that 'prefect fit' and you won't hire anyone, or you end up with hiring the only applicant to get past the roboreader. Seek a broader standard and you'll find plenty of good people even though mr perfect never appears.
- Dylan16807 11y ago>I don't see the problem. The fact that no person fit the model perfectly doesn't mean that the model was a poor choice. Did you skip the part about people dying?
- throwaway_exer 11y ago> A cockpit is not a suit. The opposite is true. To fly an airplane with precision, you need to "strap the airplane on." That means sitting in the position with the best visibility and best reach inside the cockpit, even a Cessna 172. (In a 172, you should sit high enough to be able to see each of the rivets on top of the cowling.)
- sandworm101 11y agoYes, but the seat does adjust. It isn't the case that the cockpit must be tailored to every person. Each Cessna, 747 or f-16 seat is practically interchangeable amongst the type. These aren't WWI biplanes with nothing more than a cushion. Even then, the cushion height, the prime dictator of eye level, is adjustable.
- beachstartup 11y agoanalogous anecdote: if you've ever tried to drive a sports car in a seating/steering/pedal/shifting position that isn't tailored to your body, it feels really awkward and it's very difficult if not impossible to drive fast with precision. i would guess that in a sports or race car, everything needs to be within a few millimeters of where it "should" be in order for it to feel right. multiply the speeds and divide reaction times by 4-5x and i can see how you could easily crash a plane with a tiny margin for error.
- ocdtrekkie 11y agoThis is incredibly poignant in a world where our designers and engineers are moving to provide users less options and less configuration, deeming their ideal designs, meant to meet 'most users needs', is superior.
- pacap 11y agoexactly!
- TreeMan 11y agoMy company Treemetrics has been challenging the forest industry for method used for measuring forests. They use the average tree size as the method for valuing a standing forest. From our data we see forests with thousands of trees where only a handful of average trees actually exist. Very helpful article for me to explain the flaw of averages.
- Sophira 11y agoFor anybody getting a message that says "Please try loading the page again after activating mobile data or connecting to a Wi-Fi network." = it's not your connection, despite what the page says. The mobile site, http://m.thestar.com/ http://m.thestar.com/ , is giving that message on desktop too and it comes from the site itself.
- dap 11y agoThis is a great example. It doesn't take a lot of dimensions, though. I've seen many system workloads where the average latency was not the latency of any of the requests.
- ckib16 11y agoThis was a very interesting article. And I can’t speak to the statistical methodology described. But I think it paints too broad a brush in terms of why the Air Force fatality rate (or “Class A Mishap Rate” as it’s called) decreased over the decades. Quick side-note – I’m a former USAF pilot and studied USAF history a bit. The short version is – technical details like adjustable cockpits certainly played a part. But the bigger driver was the ever-increasing culture of safety, mishap prevention and leadership accountability. Safety: things that were common place “back in the day” have been banned for many decades in today’s Air Force. These include traveling without appropriate weather checks, acrobatics maneuvers at low altitudes and unauthorized airspaces, and flying without enough sleep. Mishap Prevention: incredible resources are poured into scientific investigations on what exactly happened in each incident so that A) we can learn from it and B) all pilots can be briefed on the mistakes made so that they can save their own lives. Leadership Accountability: if you are a senior leader at an Air Force base with a fatality, you have a large issue on your hands that needs to be handled with extreme attention to detail. Lapses in safety are not looked favorably upon at any level. I wasn’t in the USAF back in the day. But it’s fairly obvious that there was less punishment meted out when mishaps occurred compared to when they happen now. Different times – yes. But overall fatalities were just accepted as “something that happens.” The safety culture is all-pervasive and common in today’s military. But there were different attitudes back in the ‘40s. So while many of today’s pilots gripe about the excesses of safety culture - and I was one of them – most pilots know deep down that it’s a good thing. I wouldn’t want to return to the old school days where crashes were just the cost of doing business.