3 ms·
The point of an IQ test is to measure g, or general mental ability. In other words, if a computer can test well on one IQ test, it may also test well on other I
by threatofrain 11y ago
The point of an IQ test is to measure g, or general mental ability. In other words, if a computer can test well on one IQ test, it may also test well on other IQ tests, since it should be general. Otherwise, it's a domain-specific ability for a specific IQ test, which wouldn't be as interesting.
If a system could perform generally well, then the implications are astounding. It could imply general analogizing capability. It would also mean AI came way faster than anyone thought.
- sageikosa 11y ago...or, it could indicate a system optimized for the goal of performing well on the metric of taking a specific type of test... With a little prodding and tweaking, I can imagine a search engine doing decent on many classes of standardized tests; and so can test administrators, leading (partially) to why smart-phones/computers/connected-devices are generally forbidden when taking standardized tests.
- Vraxx 11y ago..but let's not overlook the fact that standardized tests aren't exactly stellar at determining "intelligence". I've had tests that allowed all manners of resources to be used during the test and it was still a difficult test.
- jcfrei 11y agoIn their paper they mention that they only did the verbal reasoning part. I'm pretty sure an AI algorithm that solves all three parts ( logic questions, mathematical questions and verbal reasoning) without some hard coded heuristics for the mathematical and logic part doesn't exist just yet.
- jakobegger 11y agoIQ tests may be designed to measure g, but that doesn't mean they actually do. The best thing we can hope for is that a test correlates with g. But for every finite test it will be possible to find an algorithm that will produce high marks without requiring general intelligence. In the specific case outlined in the article it's clear that they only found a method to answer a very specific type of test. (And all that's assuming something like g even exists.)
- deleted 11y ago[deleted]
- chii 11y ago> But for every finite test it will be possible to find an algorithm that will produce high marks without requiring general intelligence. if you didnt know what the test was, then this procedure of using a "specific" algorithm is not distinguishable from general intelligence!
- mbq 11y agoThis is only for certain, verbal questions like antonym of, synonym of, X is to Y as Z to what; for each of them a separate, specific model was built (not that the AI read the question and printed relevant answer). To sum up, the paper should be titled "Dictionary is better than MechTurk users on look-in-dictionary tasks." Link to the original paper: http://arxiv.org/pdf/1505.07909v1.pdf http://arxiv.org/pdf/1505.07909v1.pdf
- jessriedel 11y ago> In other words, if a computer can test well on one IQ test, it may also test well on other IQ tests, since it should be general. > If a system could perform generally well, then the implications are astounding. It could imply general analogizing capability. There is no reason to expect this at all. IQ tests are designed to measure $g$, which is a strong, profoundly important, but imperfect correlation among humans in how they perform across many cognitive tasks. The fact that all these different tasks (even reaction time!) are correlated for humans is weak evidence that they are all influenced by a single biological factor. However, there is this very little reason to think that all these tasks will be correlated for arbitrary reasoning systems, especially a system specifically trained to perform on one specific test. An analogy: the lengths of various body parts in humans (finger length, leg length, etc.) are all very correlated, and point to a general factor of size, i.e., it is reasonable to talk about "tall" humans and "short" humans, which generally have all their body parts longer or shorter, respectively. But if we're designing humanoid robots from scratch, there is no reason to expect there to be such a general factor of size. Some robots will be designed for welding car doors, and will have arms but no legs! In short, the fact that IQ tests measure g, which is then predictive across many cognitive tasks, is crucial based on the fact that the sample set is humans, for which a small number of causal mechanisms (genetics, nutrician, etc.) are responsible for the correlation.
- Uhuhreally 11y agoThe point of an IQ test is to measure IQ, or "Intelligence Quotient", or how intelligent someone is, except what it really measures is how good people are at doing IQ tests. Nobody agrees what Intelligence is, and people with a high IQ are not always clever.