13 ms·
Further Evidence That IQ Does Not Measure Intelligence
- zachlatta 13y agoI'm glad that there's further evidence that IQ doesn't correlate with intelligence. I've never been a fan of quantifying intelligence or other characteristic attributes.
- hackinthebochs 13y agoYet more overreach in the conclusions people take away from studies such as this. So there is an environmental factor in what IQ tests measure; this should not be a surprise to anyone. The study suggests that one's environment growing up affects your abstract reasoning ability. This in no way suggests that it is completely environmental. Height is largely genetic, we all know that. Yet height is also strongly affected by environment. In fact, if you don't feed a kid, they don't grow at all. This does not mean that height has 100% correlation with nutrition and thus zero correlation with genes! People need to be careful with drawing convenient conclusions from a small amount of data.
- luxpir 13y agoJust to clarify; the study doesn't say that intelligence is completely environmental, but the reporter draws the conclusion that IQ test results are 'mostly environment and experience', which I'll agree is a reach. But I'd welcome the study itself, further distancing us from the consensus, among what could well be the majority, that intelligence is innate and that IQ tests measure this quality.
- Swizec 13y agoWhy is this a problem even? Why can't IQ be the result of both genes and the right environment and upbringing? Why is it any less valuable as a measure if it's affected by environment? Sure, there's more to "that person is clever" than just your raw computing power, but it's a pretty damn big factor.
- netcan 13y agoHere's the weasl-ey straw man (sort of): "..some thinkers cling to the idea that IQ measures an inborn intelligence that transcends culture and schooling. If that's true, one would expect that the most abstract, "culture free" elements of IQ testing wouldn't be subject to." The evidence supports common sense on the idea that environmental factors influence IQ (and intelligence) substantially. I doubt many "thinkers" disagree.
- Ygg2 13y agoThe evidence also support that IQ test are really hard to do correctly. Some IQ test are better done by urban vs rural children and vice versa and it comes to what knowledge does IQ test verify and what method does it use. It's not as easy as saying its environment. Test makers suck at thinking outside their head and disabling their own knowledge expectations and biases.
- einhverfr 13y agoI would question the premise actually that intelligence can be represented adequately by a single scalar quantity. a much better approach would be an n-dimensional vector. The problem you get with a scalar measurement is that you end up with weighing one component of intelligence against another. IQ tests don't spend all questions measuring the same exact skills of course, so you have to have a way of weighing one skill against another. That weight itself can only be culturally derived, and therefore IQ tests in their current form have no hope in measuring innate abilities on an apples to apples basis because in the end we are comparing apples to melons.[1] [1] Hats off to you if you got the pun, which will only be found through careful study, knowledge, and reading slowly.
- lemonfreshman 13y agoThis actually confirms that IQ measures intelligence, just not merely innate intelligence. Which we already knew.
- mc-lovin 13y agoWell the article claims IQ measures the capacity for abstraction, which isn't necessarily the same as intelligence: the best programmer isn't the one who always starts with a UML diagram.
- iopq 13y agoHuh? Programming is basically abstraction taken to the extreme. It's writing repetitive code and then going "you know what would make more sense? If I could abstract this repetitive part into another construct and then reuse it". A programmer who has bad abstraction skills will just copy paste a few times and modify the necessary parts. And forget to change stuff in a few places probably.
- luxpir 13y agoIt is refreshing to see this kind of research promoted, particularly by an 'extremely learned person'. The submission reads to me as a sort of call to arms, as someone who feels that education has been a great privilege and bonus to their life. A privilege which is now unfortunately being sold off to the highest bidder in most countries. From my own experience, learning second/third languages has had a noticeable broadening effect on thinking processes. Not in the proud sense of being 'broad minded', but noticeably better able to engage in abstract concepts. Basically the ability to compare seemingly unrelated notions felt tangibly improved after learning how my speech in English was actually constructed, and how my words and phrases were just $variables for actual concepts. And I'm quite convinced that given the right chances in life, anybody can learn any of a thousand subjects that would have a similar effect. The end benefit to society? Impossible to say for sure, but you can bet good money on the additional creativity being an improvement on the previous generation in terms of progress. This article, and others like it, are great to read but one aspect I would like to see further developed would be the effect of role models and the origin of aspiration in a person. Is it even possible to give more people the desire to want to learn more? Are some people just naturally more 'competitive'? What role does gender play? On a final note, Radio 4 this week interviewed a panel on women going into Physics, in particular. It was a ridiculously low amount, and one of the female panellists excused this with the reasoning that 'girls often prefer biological sciences'. These kind of assumptions, and a complete ignorance of any potential underlying social issues, are what get my goat. So many thanks, Colin, for submitting this.
- Tenoke 13y agoThis is not evidence for anything - the theory kind of checks out but it can be argued that there are other confound variables and that the direction of causality is not as simple as they make it out to be. Also just because IQ can be (slightly) trained it does not mean that it does not measure 'intelligence' - what is the problem with intelligence being trainable (not that IQ is perfect or anything)? And lastly - yay for meta.
- arethuza 13y agoDoes anyone here really believe that IQ tests have any value?
- queensnake 13y agohttp://en.wikipedia.org/wiki/Intelligence_quotient#Social_outcomes http://en.wikipedia.org/wiki/Intelligence_quotient#Social_ou...
- hackinthebochs 13y agoI do. It is correlated with all kinds of positive outcomes in life. Given a somewhat similar cultural upbringing, there is clearly something different about someone with a 140 IQ vs someone with a 100 IQ. This fashionable meme that IQ is meaningless has no basis in fact. It certainly doesn't measure innate potential exactly, but then not too many people would say that these days anyways. However, it does correlate with something regarding one's mental capacity, and this correlation also correlates with other important outcomes.
- PavlovsCat 13y agoIt is correlated with all kinds of positive outcomes in life. I beg to differ, and I have this quote to rationalize it: "Pain and suffering are always inevitable for a large intelligence and a deep heart. The really great men must, I think, have great sadness on earth." -- Fyodor Dostoevsky Would I rather be stupid and happy? No! And maybe I'm not of "large intelligence" in the first place, but I'm intelligent enough to often feel very disconnected and alienated from the society around me. I learned how to tell people what they want to hear, but inside I often feel like I'm trapped in some kind of zoo. The heat death of the universe is the only grown up thing I actually get to deal with, and I get to deal with it alone, while most everybody else is either drunk on brain chemistry or not playing in that league. I feel like I'm sitting in some kind of waiting room where there is nothing to do. If it wasn't for things like music, dancing, cats, dogs and toddlers, there is no way I would have made it this far. Flowers and sparrows nourish me, people are a chore. Capitalism? Don't even get me started, unless you're willing to give me an army with which to solve the issue. And now I'm going to completely contradict myself and say that intelligence is like the horse power of an engine; yeah, it matters, you cannot go anywhere without an engine, and you can't go fast or far with a crappy one. BUT what might matter even more is the steering wheel, and I totally suck at using that. I speed around a lot and end up in ditches, and I think there is something to the "saying" that more intelligence makes bigger mistakes possible; I am a living example of that. I know I am just whining. My personal inability to enjoy life and other people doesn't have to mean intelligence isn't generally positive; but still, when it comes to society and living and working together, it's all rather relative, and being too smart or too stupid both can easily lead to inefficiencies and heartache. Humanity as a whole might have better outcomes if it was more intelligent as a whole, but individuals being too far ahead cannot do much other than acknowledge all the beautiful things that could and should be but never will. That said, I would never ever want to swap. I'm sure less intelligent people have things they are sad about as well, while being worse equipped to reflect on them, and I do not envy that at all.
- yoran 13y agoIn my own life, I see more and more "evidence" that IQ, or academic achievement, is the wrong metric for intelligence. When I grew up, everyone was telling me that intelligence is in direct relation with how you perform at school. Someone who performs well at school is by definition intelligent, someone who is not good at school is not intelligent. Simple. This went on after high school. Here in Belgium, the better students go to university while the less achieving students go to something directly translated to English as "high school". A "high school" in Belgium is a more applied type of study. For instance, you won't see any theoretical computer science course (decidability, complexity theory) taught at a "high school". Again, it was assumed that universities produce the intelligent people and "high school" the less intelligent people. During the past few months, being part of a startup, I've worked with several people who in my eyes are intelligent. These guys can come up with creative solutions to problems, well into the realm of out-of-the-box thinking. However, they don't all come from universities. Some have a "high school" degree, or no degree at all. It made me realise that academic achievement is not a good measure for creativity. While for me, creativity is an important factor in intelligence. Many fellow students in my university computer science course were "intelligent" by academic achievement (after all they were able to finish an engineering university degree) but I wouldn't call them intelligent, just because they lacked this creativity. They were good when they were being told what to do but had a hard time thinking out-of-the-box. And I think that creativity is so important in the definition of intelligence. I'm not saying that intelligence is all about creativity. Someone who can think creatively and think analytically is more intelligent than someone who is just good at thinking creatively. But I'm saying that academic achievement (typically related to IQ) is not a good measure for intelligence because it lacks that "creativity" factor. "Ken Robinson says school kills creativity" is a great TED talk about this (http://www.ted.com/talks/ken_robinson_says_schools_kill_creativity.html http://www.ted.com/talks/ken_robinson_says_schools_kill_crea...).
- ars 13y ago> IQ, or academic achievement > When I grew up, everyone was telling me that intelligence is in direct relation with how you perform at school. Your mistake is equating IQ with academic achievement. That's not what it is. It helps. But it's neither necessary nor sufficient. Academic achievement is something else.
- aaron695 13y agoI always find it bizarre the consistent need for a certain types of people to believe IQ tests are not real. It's pretty much conspiracy sort of stuff. A. It's quite a stretch that a whole scientific community can't create a test for IQ and get past the tired issues brought up 50+ years ago. B. The concept brains unlike heights, hair, body shape etc etc etc are all the same is pretty ludicrous. There is lots of stuff on the Flynn effect, I'm sure people can google it for themselves. But at the end of the day why is it so strange a test given to people in the 1960s scores differently for people in the 2010s. It is such a strawperson argument. IQ's about relativity and ability in the current environment.
- strangestchild 13y agoScientists definitely do have a test for the so-called IQ, and it's called the IQ test – but 'Intelligence Quotient' and intelligence are not synonymous. One need only read Mensa magazine to realise that IQ does not constitute intelligence in a meaningful sense. It's clear that brains vary, of course, but 'intelligence' is too broad a term to say, quantitatively, to what degree a person possesses it. The term encompasses: - The ability to acquire new knowledge quickly, or to learn difficult things at all. - The ability to, given time, make nontrivial deductions from given data. - The ability to make rapid deductions in short periods of time about given data. - The ability to generate multiple unrelated solutions to a problem. - A high level of verbal proficiency. We mean all these things to different degrees at different times when we use the term; and although these are not orthogonal concepts, they clearly do not exist in a one-dimensional space. Certainly if IQ is taken to mean 'the raw, unchanging potential of a mind', the Flynn effect is inexplicable given that the timescales involved are far too small for our neurobiology to have adapted evolutionarily. Given that it means very little other than 'the ability to pass IQ tests', the Flynn effect is perhaps not surprising at all.
- ars 13y ago"You Are Probably Not Much Smarter or Dumber Than Anybody Else" I've noticed that people seem to be completely unable to really understand that some people are actually smarter than them. Most commonly they will confuse aptitude for intelligence. i.e. they easily acknowledge that this person just likes intellectual activity. But can't seem to grasp the difference in intelligence. The same [relative] lack of intelligence also robs people of the ability to understand intelligence in others. It's easy to see when someone is less intelligent - it's much harder to really grasp that someone people are smarter. It's like trying to explain a red to a colorblind person who can't see red. They kinda get that it's another color like others they've seen before, but they just can't grasp that it really exists. You also (less commonly) get the reverse - someone really smart doesn't understand why everyone can't do it. An example: Srinivasa Ramanujan heard the number 1729 and instantly thought of an interesting property for it. This ability to do that for a number just doesn't exist in most people. It doesn't matter how hard they try or study - they just can't do that.
- fnayr 13y ago1*7+2=9
- yaakov34 13y agoThat's not a property of the number 1729, that's only a property of the decimal notation for the number; an important distinction. The property is also trivial. Ramanujan's property - that the number is expressible in two different ways as a sum of two cubes, and in fact the smallest number so expressible - is a property of the number. That Ramanujan had different innate abilities from the vast majority of people is about as clear as the midday sun.
- einhverfr 13y agoThere are two problems though with this view. As a disclaimer, there are people who I consider much smarter than I am at certain things, and many people regard me the same way. Some of that may be my attention deficit and the effort I have had to put in to being successful despite it. I think the problem though is different, however. I am going to say two things: 1. Intelligence is not definable to the point where it can be tested, and 2. Attitude > innate intelligence. I expect both these will not be so welcome in the HN community as such, so I am prepared for downvotes, but I also dont think these are wrong either. On the first, the fact is that people process information differently. Ramanujan processes a number a certain way. Someone else might associate it with a year and immediately make historical connections. Someone else may factor get fascinated and factor it. There are bunches of ways a piece of information can be processed and the weighing of one as better than another is ultimately a cultural judgement and ultimately what proves to be an interesting property depends on what we find fascinating (which brings me to my second point). On the second, I have found all my life that the smartest people I have known have always been the most humble, and to regard everyone else as being worthy of learning from. I have consequently come to regard intelligence as a two-fold habit. The first part is the habit of finding everything interesting in life, what I call an unwillingness to be bored (something that really comes through in Feynman's memoires). The second is regarding everyone as someone to learn from (Heisenberg btw comes across this way very much in "Physics and Philosophy"). If you go around learning from everyone, and refuse to be bored, you will quite quickly become smarter than everyone else if they refuse to do the same.
- scotty79 13y agoPeople who had learned maps to become proper London cabbies tend to be better at memory tests later on. So should we conclude that culture of memorizing stuff they experienced is responsible for their high marks? And somehow that biology determining their physical aptitude isn't involved? This does not follow. Their brains changed visibly on MRIs over the course of map learning. Of course that's the culture that makes people more intelligent. But you can't dismiss this gain of IQ as not real or non biological. That's probably the only real IQ gain that we ever got since our animal ancestors decided that it's better to live in groups, and they themselves became their smartest competition. Culture is just a fancy name of all of human interactions.
- nnq 13y agoWell, it still measures relative intelligence for people with similar education, and in our globalized society our educations and exposure to information get more and more similar, so it's very good at what it's suppose to do and my guess would be that is getting even better as "cultural homogenization" in the global village increases... Now, we all know that intelligence is just a variable, it does not singly predict suitability for a certain job and it's very bad at predicting things like "success in life", but it is a useful variable!
- WalterBright 13y agoWhy do people breed dogs for all kinds of absurd characteristics, but nobody has tried to breed dogs for intelligence? I've seen reports that some dogs achieve a vocabulary of 400+ words. What would happen if one selected for that? Could you conceivably get a dog you could have a conversation with?
- einhverfr 13y agoIf you ever spend much time in a foreign language learning a very different language (bonus points for it being non-Indo-European), you will note that there is a huge gap between understanding hundreds or thousands of words and being able to carry on a conversation.
- WalterBright 13y agoOf course. But it's a good starting point.
- egiboy 13y agoI don't think IQ tests are immune to grade inflation (http://en.wikipedia.org/wiki/Grade_inflation http://en.wikipedia.org/wiki/Grade_inflation), so I am inclined to think of Flynn effect as a special case of it.
- dgellow 13y agoI always considered the intelligence as an abstract concept. Like a way to named the group formed by curiosity, flexibility, adaptation and others capacities to understand relations and interactions between elements. By the abstract nature of that set of attributes, I don't understand how it could be measured. By the way, what is your definition of intelligence ?
- circlefavshape 13y agoThe only definition of "intelligence" that matters is "whether you seem intelligent to other people". That's what an IQ test attempts to measure, not the raw processing power of your brain
- einhverfr 13y agoI think that one of the huge problems is that there has never really been to my knowledge a systematic look at the epistemological limits of IQ tests. However just looking at it quickly I can spot two huge epistemological issues which make IQ tests more or less worthless for objective study, and more or less cultural artifacts. The first, which I have mentioned in a few posts is that at some point you end up comparing apples and melons (the pun for those of you who didn't get it is that 'melon' is Classical Greek for 'apple'). These things may be things where we can make connections but any cultural weight we place on one relative to another is just that, a cultural weight. For this reason intelligence, even if IQ tests measure what we expect them to (and I am not sure of that, see below), the results cannot be objectively reduced to a single number. You would really need to look at intelligence as a multi-dimensional vector with the understanding that we might be missing some aspects anyway. The second problem though that I can spot immediately is that some skills they want to test cannot be objectively tested. The big one that comes to mind is pattern recognition. If you haven't read it, I think Heisenberg's "Physics and Philosophy" is a must read here because his discussions of the relationship between data and theory are directly relevant to this. When we recognize a pattern what we actually do is we project assumptions onto the data and find a pattern which fits both the assumptions and the data. This is the process Heisenberg articulates regarding the formation of scientific theories. The pattern recognized is both a product of our assumptions and the data and therefore patterns are at once recognized and created. Of course Heisenberg was talking about his forte (theoretical physics) but the same applies here because this is a human process. The simple fact is that several competing sets of patterns can be made to fit the data. For example, take the following set of items: Hammer, log, ax, saw Which one doesn't belong? One pattern might be to that "hammer, ax, and saw" are the pattern and log is the outsider. Another pattern might be "I can build something with the hammer, the log, and the saw, much more than I can with any other combination so the ax doesn't belong." Therefore such a question has at least two legitimate answers because two different set of assumptions can be projected onto the set with very different results. Now typically we are going to say one of those (the first, "log" doesn't fit) is correct and the other is wrong, but that doesn't actually test the ability to recognize patterns so much as it tests the ability of the test taker to figure out the answer that the author wants. This makes pattern recognition fundamentally culturally determined and if you can't get away from this you can't quantify this through standardized testing. But let's take this further. We typically refer to a genius as someone who finds useful patterns that nobody else does. The IQ test then, if we accept Heisenberg's epistemology, should actively select against genius in these areas-- either the patterns must be trivial, or they must be sufficiently complex you cannot be sure whether a "wrong" answer in fact does not have a recognizable pattern to it. So you end up having to throw out a good chunk of the test here as being very closely culturally determined (and basically an exercise of mind-reading the author). The first problem could be solved by expressing intelligence as a multidimensional vector, but the second is much more problematic. How do you know that the test answer is right and the test taker is wrong when it comes to two competing patterns seen in the question?