4 ms·
IQ tests don't measure intelligence perfectly, especially at the higher ranges. I would not use the word "measure" at all, but rather the word "estimate," for
by tokenadult 18y ago
IQ tests don't measure intelligence perfectly, especially at the higher ranges.
I would not use the word "measure" at all, but rather the word "estimate," for theoretical reasons mentioned by psychologist Joel Michell. It is well known that reliability of IQ tests is at its worst at the highest level of IQ scores. The author of the test that Marilyn vos Savant took was among the first to say so:
"The reader should not lose sight of the fact that a test with even a high reliability yields scores which have an appreciable probable error. The probable error in terms of mental age is of course larger with older than with young children because of the increasing spread of mental age as we go from younger to older groups. For this reason it has been customary to express the P.E. [probable error] of a Binet score in terms of I.Q., since the spread of Binet I.Q.'s is fairly constant from age to age. However, when our correlation arrays [between Form L and Form M] were plotted for separate age groups they were all discovered to be distinctly fan-shaped. Figure 3 [not shown here on HN, alas] is typical of the arrays at every age level.
"From Figure 3 it becomes clear that the probable error of an I.Q. score is not a constant amount, but a variable which increases as I.Q. increases. It has frequently been noted in the literature that gifted subjects show greater I.Q. fluctuation than do clinical cases with low I.Q.'s . . . . we now see that this trend is inherent in the I.Q. technique itself, and might have been predicted on logical grounds." (Terman & Merrill, 1937, p. 44)
- Alex3917 18y agoIMHO, the word measure seems more appropriate. Your IQ is just a number that measures how many questions you got right on an IQ test with the number of questions the median person got right. It's an exact number, not an estimate. As for what this means, it's neither a measure or an estimate. It just is. It might correlate with some stuff, but it doesn't seem appropriate to use either 'measure' or 'estimate' to describe any such relationships.
- tokenadult 18y agoYour IQ is just a number that measures how many questions you got right on an IQ test with the number of questions the median person got right. It's an exact number, not an estimate. No, the IQ test result purports to say something about the test-taker's "intelligence," that is about how the test-taker would perform doing other tasks on a different occasion. And that is why every IQ test result is best described as an estimate. The longer answer about why most mental test results are best not described as measurements has to do with the technical meaning of "measurement" as it has developed in sciences preceding psychology, and that answer is given very nuanced discussion in Joel Michell's book Measurement in Psychology http://books.google.com/books?id=QXAAhBN8ZScC&dq=Joel+Michell&printsec=frontcover&source=bl&ots=4Km0k2dyIU&sig=iYJkACquLj4Zo5WZSxXtB1Jq6Tg&hl=en&ei=oJDiSffRB5qYtAPlkem4CQ&sa=X&oi=book_result&ct=result&resnum=6 http://books.google.com/books?id=QXAAhBN8ZScC&dq=Joel+Mi... P.S. IQ test scores typically do NOT describe in any straightforward way what the item-content score of the test-taker was, and it's possible, on the same form of the same brand of IQ test, to obtain identical IQ scores with other test-takers without having identical item-content performance.
- Alex3917 18y ago"No, the IQ test result purports to say something about the test-taker's "intelligence," that is about how the test-taker would perform doing other tasks on a different occasion." Do the makers of the various IQ tests each publish a document that says how well people with various IQs will perform at other tasks? edit: Thanks for the link to the book, this is great stuff. I've been looking for a book like this for a few years, because it's been bothering me for a while now that there doesn't seem to be any philosophy of what can be measured vs. what can't. I'm glad I'm not the only person to notice this problem.
- tokenadult 18y agoDo the makers of the various IQ tests each publish a document that says how well people with various IQs will perform at other tasks? Typically, a technical manual for each new brand of IQ test, which may only be available to authorized psychologists but perhaps not to the general public, will publish the results of the test's norming administration, which might include statements that IQ test scores of people in certain defined occupational categories ranged from X to Y. As you can imagine, there is overlap between the scores of the smartest manual laborers and the dumbest professionals. Most occupational categories have a wide range of scores, but in general the occupations you'd expect tend to have higher mean IQ scores than the occupations not considered to require much smarts. Yes, the measurement issue is very interesting in psychology. I have huge buy-in to Michell's conclusion that most of what is called measurement in psychology should not be called "measurement" at all. I see the consequences of the usual terminology in arguments by analogy in popular discussions of psychological tests (such as this thread), where it is commonplace for participants who have not read many psychological treatises to treat, say, IQ test scores in a way that is not warranted by how they are derived.