4 ms·
But how do you select 'intelligent' people to generate your 'intelligent' answers? If it's not at some point tied back to some kind of objective performance (ge
by taneq 10y ago
But how do you select 'intelligent' people to generate your 'intelligent' answers? If it's not at some point tied back to some kind of objective performance (generating correct answers) then you're not measuring intelligence.
- thaumasiotes 10y agoThat's wrong. If your subjective test agrees in result with your objective test, they're measuring the same thing. That we can't begin the study of intelligence tests with a fully subjective test wouldn't mean we can't end there (and in fact, we can begin that way, because we start off with the idea that someone is smart if other people are inclined to describe them that way, not that someone is smart if they do well on a math test).
- jldugger 10y agoThese are not intelligence tests, they're cognition tests. The goal is not to seek the correct answer, but a correct answer.
- thaumasiotes 10y agoSeeking a correct answer is trivially easy, though; you can always find the rule "any of the six shapes on the left", just as you can always fit a function to any arbitrary sequence.
- jldugger 10y agoRight, but the context is that these problems comprise an evaluation suite for artificial intelligences. Even simply textually describing the shapes on the left and the right, is an accomplishment. A better test suite would likely provide an oracle capable of generating new images belonging to the left or right and asking the program to judge which side it belongs to.