4 ms·
It was amusing to see the quotations from Wikipedia articles (which I have worked on) that appear in the authors' paper without any citation to Wikipedia. They
by tokenadult 11y ago
It was amusing to see the quotations from Wikipedia articles (which I have worked on) that appear in the authors' paper without any citation to Wikipedia. They have made some effort to look up the background of IQ testing, to the extent of cribbing from some Wikipedia articles, but their citation of the actual peer-reviewed psychology literature on IQ testing is all but nonexistent (they cite mostly machine-learning papers), and as several astute comments point out, training a machine (or, for that matter, a human being) to perform specifically well on the specific item content of a test does NOT raise the inference that the specially trained human or machine is generally smart at whatever else the test-taking-trained human or machine does.
Another serious objection to the study, also brought up in some previous comments, is that IQ scores are norm-based scores (they compare test-takers to a general population, not to criteria of correct or incorrect answers), and it is very likely here that the Mechanical Turk recruits found for the study are NOT a representative sample of the relevant population of human beings for comparison to the machine's performance.
But my most serious objection to this study, among several, is that the item content chosen for this study was not even items professional developed and pains-takingly tested item by item by psychologists for inclusion in an IQ test battery, but rather the kind of dreck usually found in unvalidated online IQ tests, which are simply parlor games and should not be taken seriously. The study to a very great degree demonstrates the well known computer science principle "garbage in, garbage out," and does regrettably little to advance the literature on artificial intelligence.
For readers who would like to read some of the legitimate psychology research literature on IQ testing, I strongly recommend the Wikipedia article "IQ classification," which has a better bibliography (by far) than any other Wikipedia article about IQ testing.
https://en.wikipedia.org/wiki/IQ_classification https://en.wikipedia.org/wiki/IQ_classification