15 ms·
Taleb is wrong about IQ
- zajio1am 7y agoThe most fascinating thing for me in the article is bimodal distributions in the last grap, where lower peak is ~same as the peak for low-iq distribution. I wonder what is the cause for this.
- chabes 7y agoTl;dr from the article: > All the claims from the article that I looked at, that can be interpreted as something specific and tested in a real data set, turned out not to be correct. If Taleb hadn’t blocked everyone who disagrees with him, perhaps he would have found out about this, and not published a post with all these incorrect claims.
- sampo 7y ago"The first principle is that you must not fool yourself — and you are the easiest person to fool." https://en.wikiquote.org/wiki/Richard_Feynman https://en.wikiquote.org/wiki/Richard_Feynman
- tw1010 7y agoBut Taleb is specifically arguing against simple linear correlation measures like R^2. (See figure 1 in Taleb's article.) Feels like you haven't grasped the specifics of his argument without taking that into consideration.
- cheez 7y agoNot only that but the best argument shows almost (but not quite) marginal contribution.
- 1000units 7y agoTaleb's IQ is simply too high.
- vipa123 7y agoI don't understand. Are you saying the author shouldn't point out these errors, given what Taleb is arguing against? Or they aren't actually errors, given that the author hasn't grasped the specifics of Taleb's argument?
- tw1010 7y agoTaleb argues against R^2, and the author of this article seems to just ignore those points. I think Taleb has valid points, but the author here seems to be doing just the same conventional analysis that people writing psychology papers tend to do, which Taleb specifically argues is an invalid way of doing things (because assumptions built into linear correlation measures doesn't apply in this situation).
- jamesmadison66 7y agoThis is a really frustrating issue with criticism/response to Taleb. Taleb: "There are problems with A because of B reasons" Response: "B reasons prove A" I really don't understand why this is so common. I don't fully agree w/ Taleb that the academic demographic he tends to pick on is so lost to navel-gazing that it is completely unable to understand the context of his arguments, but it's really odd how common this is. To clarify, I'd love to see someone who actually understands Taleb's arguments to push back at him from the same premise. He says some really controversial (and potentially hugely important) stuff that needs to be challenged and peer-reviewed just to get a basic second opinion on it. This has yet to happen really because of what I described.
- zxcb1 7y agoIQ is useful to me. Whenever someone thinks it's important I gain useful information about that individual
- saas_sam 7y agoPretty cruel to ignore IQ and leave millions of mentally disadvantaged people in the lurch.
- runarberg 7y agoYou’re not wrong. IQ (or more generally intelligence tests) are very useful to diagnose people with some mental disabilities. That said: a) the IQ part of the intelligence test is sort of unnecessary for that purpose, and b) That’s usually not what people are (righfully) criticizing IQ for and you know it.
- Retric 7y agoThe difference between IQ at 20, 60, 100, 140, and 180 are all noticeable. However, the gaps become less impactful as you go up the scale. Simply because fewer activities are really impacted. Digging a ditch with a shovel for example is only so difficult.
- MagnumOpus 7y ago> because fewer activities are really impacted ... Digging a ditch with a shovel Yes, and that is why over time this is becoming more important. To put out some arbitrary numbers, you can use a shovel with an IQ of 70, you can operate a backhoe with an IQ of 90, you can engineer the backhoe with an IQ of 120. Manual shoveling disappeared as an occupation 50 years ago apart from niches, driving as a profession might disappear in the next 15 -- and it does matter whether the people made unemployed by technology can be upskilled to be repairmen/engineers/programmers. If IQ is >50% genetic, they can't and you have to figure out how to deal with 10-20% of the population being permanently unemployed or employed in extremely-low-skilled jobs.
- concinds 7y agohttps://twitter.com/UntergrundmannG/status/1155835475946381313 https://twitter.com/UntergrundmannG/status/11558354759463813... "Taleb has an updated post up at medium that takes care of most of this. You could take the time to weigh that in against this all over again. And if you come back here in a few days, I may have a post up about how this is a trivial misunderstanding of NNT's case. Quantitatively." Anybody who understands Taleb's argument realizes that these "counterarguments" are missing the mark. The fact that they spend more time obsessing his "meanness to them" than on his arguments, without understanding that his meanness is never directed at people who disagree, only people who bullshit, proves that point.
- jamesmadison66 7y agoCompletely misunderstanding NNT's arguments' basic premises in rebuttals to him seems pretty common.
- pennaMan 7y agoThat's because he tends to go after things that are widely misunderstood in the first place.
- mrandish 7y agoTaleb is, as usual, a bit over-wrought and goes too far but this area has been a long-time interest of mine and I think he's directionally correct in that IQ is too often misapplied or misunderstood in practice. In general, laypeople tend to think IQ represents things it doesn't.
- commandlinefan 7y agoBeing somebody who was always labelled as “smart” growing up - I was in the “gifted” program in elementary school, so there’s that - in a way, I want intelligence to be something that can be quickly, easily, and objectively measured, even if it turns out I'm actually not as smart as I’ve been led to believe I was. I can understand why this would make a lot of people uncomfortable, though. If IQ tests were ever shown to be perfectly correlated with that nebulous quality we label “intelligence”, it’s also not something you can improve. Your IQ, and likely your income level, are going to stick with you forever, just like your height will. Still, from what I can tell about this Taleb guy (other than that he seems like a difficult personality) is that he’s just trying to figure out how accurately IQ tests correlate with actual intelligence; he’s not railing against the concept of trying to measure it in the first place, as many others do.
- js8 7y ago> I want intelligence to be something that can be quickly, easily, and objectively measured I don't think it can be. I think (at least, important part of) intelligence is ability (or speed) to learn (patterns in the data?). So it can only be measured on something you haven't learned yet. Since as humans, we cannot "unlearn" things, the result will always be skewed by your previous experience.
- frostburg 7y agoYou can improve your score by practice. It's one of the many issues.
- mattnewton 7y agoI’m pretty unconvinced by this, the author makes a number of leaps that lost me. For instance, at the end of the article, the author says that Taleb’s claim that IQ only measures unintlelligence well isn’t true because at higher IQ, income continues to increase. This could be easily explained by numerous other third factors, like (hypothetically) IQ being a test for WASP culture and knowing WASP culture being correlated with better job opportunities.
- liability 7y ago> "like (hypothetically) IQ being a test for WASP culture and knowing WASP culture being correlated with better job opportunities." These sort of arguments always ring hollow for me, because I am not a WASP and the test I took didn't resemble a WASP-culture test in the slightest. The test I took was all "given this series of abstract geometric patterns, which comes next," not, "During which season is the weather at Martha's Vineyard the most temperate" Maybe wrapping your mind around abstract geometry is something WASPs are good at and, say, people from the Islamic world suck at, but I really really doubt that considering the relatively elevated roll geometric patterns have in Islamic culture compared to WASP culture. Of course I am neither a Muslim nor a WASP, but even so I am pretty sure I didn't struggle too hard on that test.
- mattnewton 7y agoThat’s what the “hypothetically” was for- it was meant as an illustration that there could easily be a third effect loosely correlated with both. For this to dispute Taleb’s claim, you have to think that income is also correlated with intelligence and not more strongly correlated with other things that IQ could be measuring. That example probably popped into my head first, because of the long controversy around IQ tests cultural effects and the history of using those tests to make arguments that race determines intelligence
- liability 7y agoOh, I don't claim to refute Taleb's claim because reading too much of what Taleb writes makes my head spin in a rather uncomfortable manner, and it would be unfair of me to try refuting Taleb's claims without first coolly considering them. Maybe my IQ is low after all, or maybe I just have a low tolerance for self promotion... either way, my intention is only to speak about my personal experience, which is that the IQ test I happened to take did not seem culturally biased, except perhaps to some woodsman who's never seen a straight line before (but even then I'm skeptical.)
- b1gtuna 7y agoOff topic, but how does one go about to measure his/her IQ?
- zazaraka 7y agoYou can find free online tests. They should take at least 30 min. Do 3-4 different ones to confirm you get about the same score (less than 5 points difference). If you live in a big city, you can probably find a place to do it for less than $100.
- dgellow 7y agoA lot of companies provide that kind of thing, you can easily find (good and not that good) IQ tests by searching for "standardized IQ tests" (or the equivalent in your local language). You can also contact the Mensa organization and they can put you in contact with a testing coordinator (see https://www.mensa.org/mensa/about-us https://www.mensa.org/mensa/about-us).
- b1gtuna 7y agoThanks for the link. I searched the internet, but I couldn't figure out which ones are the good ones.
- b1gtuna 7y agoFWIW, I googled IQ Test and blindly clicked on the first link that appeared. Ran through 30 questions and when I clicked on submit - it prompted for a payment lol. Should've seen this coming!
- sunseb 7y agoThis is the elephant in the room that explains why IQ is such a controversial topic: https://brainstats.com/average-iq-by-country.html https://brainstats.com/average-iq-by-country.html https://www.abc.net.au/news/2019-01-14/nobel-prize-winner-james-watson-stripped-title-race-comments/10712588 https://www.abc.net.au/news/2019-01-14/nobel-prize-winner-ja...
- zazaraka 7y agoThere does seem to be a mild correlation with outside temperature. Could some places just be "too hot to think"?
- fastball 7y agoAustralia/SE Asia is very hot, as is Mexico/SA.
- defertoreptar 7y agoI wonder if it could be the difference between areas that rely more on agriculture vs areas that must rely on their tertiary sector (where education counts for more).
- throwaway123x2 7y agoI would correlate it more with food security than with heat.
- wsc981 7y ago> There does seem to be a mild correlation with outside temperature. Could some places just be "too hot to think"? Well ... perhaps in some way: Since 1991 there has been the presumption that persistent heat affects the IQ over generations. It was initially assumed that living in lower temperatures requires a higher physical fitness and causes higher social demands. Richard Lynn, a professor at the University of Ulster in Northern Ireland, also assumes that the colder temperatures increase the brain volume. Whether brain size is at all related to intelligence, is controversial. In general, a hot climate is considered a disadvantage for the development of intelligence. The reason is nowadays primarily seen in the high physical energy demand and the resulting stress. Source: https://www.worlddata.info/iq-by-country.php https://www.worlddata.info/iq-by-country.php Another study suggests infectious diseases might be a cause for lower IQ scores. In that case, perhaps infectious diseases spread more easily in hot climates? See: https://www.scientificamerican.com/article/why-is-average-iq-higher-in-some-places/ https://www.scientificamerican.com/article/why-is-average-iq...
- jedberg 7y agoThe problem is, it has been show time and again that most IQ tests are socio-economically biased. And every "proof" in this paper is a correlation that would also hold true is you replaced "high IQ" with "had rich parents".
- tw1010 7y agoThat's not true. There are definitely papers that tries to control for socioeconomic factors.
- mc32 7y agoStudies with twins could offer some form of either repudiation or confirmation.
- skybrian 7y agoWell, the key word here is "try". There is evidence suggesting that controlling for confounding factors is very difficult and many studies don't succeed. From the outside, I'm not sure how much confidence we can have that they succeeded? https://slatestarcodex.com/2019/06/24/you-need-more-confounders/ https://slatestarcodex.com/2019/06/24/you-need-more-confound...
- ctvo 7y agoI don't know enough about IQ to refute this, but let's assume it's correct. Taleb would still be wrong about his IQ claims as is the point of this post.
- mc32 7y agoI think that would be better represented as “has access to quality education and gets trained in areas needed by the economy”.
- seieste 7y agoHow is Raven's matrices biased?
- Hermel 7y agoHave you considered the option of IQ being partially inherited and the parents also being rich because of a high IQ. In that case, IQ would still be the cause of the wealth.
- freetobesmart 7y agoIm curious what people will get out of determining measurable IQ. What are their end goals. 1) You dont get smarter. Its not like knowing you are 120 vs 100 IQ changes anything about your ability to solve a problem 2) IQ is more of a speed of learning not an ability to understand. With enough time you can learn anything (challenge placed) the biggest barrier is discipline and desire. 3) IQ is abstract and is very useless within any context. If you want to know if someone is good at math give them a math test. If they are a good writer look at their portfolio. IQ is like determining someone is good at being a chef by only asking them questions. IQ is very far from any specific field of knowledge. IQ is like space knowledge. Its only important/useful subject for a select few people.
- ohaideredevs 7y ago1. You may want to choose a less intellectually rigorous career if your IQ is low. Or you might get an early warning to work on factors you can control - for example the ability to focus, getting enough sleep, etc. 2. "With enough time..." is a totally irrelevant argument made by people who don't understand competition and how it applies to the real world, as in for scholarships, promotions, etc. Time is everything - and its a luxury. It also cuts into your free time heavily. 3. This is true. Except, when you read some code or a complex math concept, have fun if your working memory is sub-par and you can't even remember what the inputs to a function are. "Its only important/useful subject for a select few people." It's the exact opposite of that - it is applied to learning any field fast.
- nshepperd 7y agoIQ was important to determine the effect of lead exposure on cognitive function. Without it we probably wouldn't have nearly as stringent laws banning it (eg. in paint, and gasoline), and would still be suffering from endemic lead poisoning. It's not particularly important to know your own IQ as an individual (you probably already have an idea of your abilities) but it's very useful for that sort of public health purpose. If there are other neurotoxins floating around which we don't know about, IQ will be important to identify and justify banning them. https://www.ncbi.nlm.nih.gov/pubmed/8162884 https://www.ncbi.nlm.nih.gov/pubmed/8162884
- tompccs 7y agoThis does not address the substance of Taleb's arguments. Read Taleb's original article: https://medium.com/incerto/iq-is-largely-a-pseudoscientific-swindle-f131c101ba39 https://medium.com/incerto/iq-is-largely-a-pseudoscientific-... He's showing us that psychologists' statistical methods are faulty, that IQ advocates don't understand the underlying mathematics and blindly plug things into R. Lo and behold, in rebuttal, psychologists try to prove Taleb wrong by plugging more things into R.
- Radle 7y agoDoesn't mean the psychologists are wrong.
- tompccs 7y agoWell, IQ is their measure. They should be able to defend it properly. And frankly, if there is any doubt that IQ maps to intelligence, then its abuse over the last half-century has done immesurable harm to individuals and given considerable fuel to racists.
- horsawlarway 7y agoAn IQ test is a tool. Just like any other tool the way you use it matters. IQ tests turned out to be pretty useful when investigating the effects of Lead in paint/gas/industry/other. See Herbert Needleman's research from the early 80's. The test itself isn't really good or bad (bearing in mind most modern iq tests are heavily scrutinized for bias in race/class/income/location/etc) it's just a tool.
- concinds 7y ago> IQ tests turned out to be pretty useful when investigating the effects of Lead in paint/gas/industry/other. See Herbert Needleman's research from the early 80's. Taleb argues precisely that IQ is only a good measure of unintelligence, not intelligence, and that this prevent IQ from being meaningful. He showed that if you IQ test 10K people, 2K are dead (0 IQ) and then test their performance on something, you'll still end up with correlations that'll get you published in prestigious journals, and peddle nonsense conclusions. https://twitter.com/nntaleb/status/1115193783145123840 https://twitter.com/nntaleb/status/1115193783145123840 (the point being that in that scenario, 0 IQ perfectly correlated with 0 performance, can make the population correlation look significant even when "alive" IQ is completely uncorrelated with performance, which, in that example, it is)
- Will_Parker 7y agoSome things become clearer once you understand: a lot of people who say "X is invalid" really mean "We are better off not talking about X".
- dekhn 7y agoIQ arguments are the most boring thing I've seen hackers engage in. Even worse than blockchain and genetic engineering in terms of poor scientific quality, immediate jump-to-conclude-my-personal-pet-theory-is-right-because-anecdote, ignoring social factors.
- macspoofing 7y agoThey are boring, and I'm not even sure what the argument is. On the edges, I think there's a general agreement that low IQ is correlated with mental disability, and on the upper end high IQ is correlated with a certain type of cognition that makes you a good professional Mathematician or Physicist. I'm not sure what the big middle really says about anything. If I were to guess why this IQ debate keeps coming up is that it is a bit taboo now (which makes it very tantalizing in and of itself). There is also some gaslighting going on with certain segments claiming IQ is completely junk and has no genetic basis (even partially). This triggers the contrarians, who then themselves may overstate the science, prompting responses that may understate the science ... and so on.
- mistrial9 7y agohttps://en.wikipedia.org/wiki/Theory_of_multiple_intelligences https://en.wikipedia.org/wiki/Theory_of_multiple_intelligenc... there are versions of this, but is anyone surprised that an attempt of big-S Science to put a single number on humans, has fundamental challenges ?
- cljs-js-eval 7y agoOne of his repeated criticisms of analysis like this is using regression to fit datasets that don't necessarily follow a straight trend line. His larger point with respect to IQ is that it only predicts substandard IQs. Measures like the variance are largely influenced by the effects of IQs below the average, not above the average. A second point which I don't see addressed is that IQ measures share features with testing. If how you test in school affects future income, and testing well in school predicts testing well on IQ, then more robust analysis is needed. A sample space of people in a wide band of IQ ranges who all got about the same grades in school would be a true test of the predictive value of IQ on income.
- reasonaway 7y agoit is all unfounded speculation based on mathematica simulations and his own assertions. there is no empirical support for his arguments.
- tomp 7y agoOne of my favourite papers discusses this (and more): > Top 10 Replicated Findings from Behavioral Genetics > 1. All psychological traits show significant and substantial genetic influence > 2. No traits are 100% heritable > 3. Heritability is caused by many genes of small effect > 4. Phenotypic correlations between psychological traits show significant and substantial genetic mediation > 5. The heritability of intelligence increases throughout development (from 41% (age 9) to 55% (age 12) and to 66% (age 17); "unlike the other findings, this one is limited to a specific domain") > 6. Age-to-age stability is mainly due to genetics > 7. Most measures of the ‘environment’ show significant genetic influence > 8. Most associations between environmental measures and psychological traits are significantly mediated genetically > 9. Most environmental effects are not shared by children growing up in the same family https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4739500/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4739500/
- yters 7y agoThe 2000 SAT is supposedly an IQ test, and I boosted my score by 100 points by doing 10 practice exams. So, IQ probably tests some objective human faculty, but insofar as the 2000 SAT is an IQ test, it is clearly the case the IQ tests can be studied for (hence all the expensive SAT prep tutors).
- squirrelicus 7y agoCan we please agree that recognizing the rigorous science on the heritability of IQ does not imply racism?
- olliewagner 7y agoI believe his biggest issue with IQ—one that worries me greatly as well—is that it is being used to create a feeling of "otherness" towards populations that can be demarcated out using a single dimensional property: IQ. History shows us this as a strategy to subjugate using other "scientific" methods of classifying people, phrenology being a fairly recent example.
- mcguire 7y agoTaleb: "“IQ” is a stale test meant to measure mental capacity but in fact [measures] to a lesser extent (with a lot of noise), a form of intelligence, stripped of 2nd order effects — how good someone is at taking some type of exams designed by unsophisticated nerds." Well, that statement is clearly false. The exams are designed by very sophisticated nerds.
- arendtio 7y agoActually, I don't care much about if the IQ can measure the mental capacity precisely or just find those who are mentally disabled. I think the core problem is, that our society thinks of an IQ as some magical figure to determine the value of a human being. I think an IQ is much closer to what the clock rate is for computers. Just because a computer runs at a higher frequency, doesn't mean that it is computing more important calculations. In fact, there is no advantage in having 3 times the processing power if you are just running a word processor. Equally, there is no advantage in having 3 times the IQ if you are just going to shop groceries. Yes, there are a few use-cases where having more processing power is relevant (e.g. when you have a limited time to make a good and impactful choice), but I think those cases are not a frequent as most people think they are.
- dennis_jeeves 7y agoAnalogy (sarcasm): -Height differences do not exist because the measuring scale used to measure height is inaccurate. -Height differences are not dependent on hereditary because height depends on nutrition. -Assuming that height differences between the races are inherent tantamounts to racism because height differences are clearly depend on nutrition. -Bad nutrition is caused by discrimination, since bad nutrition results in shorter heights it's clearly discrimination that indirectly causes shorter height. -Height is not hereditary because short parents can have tall children and vice-versa. -Person X measures very short using a 'height' scale, but he's a great basketball player. Hence obviously height is not a factor in being a great basket ball player.