3 ms·
I’ve become less impressed with AI performing well on standardized tests. I’m not tracking AI daily so this might be a known insight, but nearly the entire spa
by onecommentman 2y ago
I’ve become less impressed with AI performing well on standardized tests. I’m not tracking AI daily so this might be a known insight, but nearly the entire space of a given discipline’s standardized test questions is enumerable by today’s computers, or very close. That’s my guess. These standardized test questions are generally of a very structured format, even Math Olympiad. “Why that’s still billions and billions of possible questions” thinks the average person. And everyone on this forum knows that this is easily manageable with today’s technology.
So the computer can train on almost all possible standardized test questions, effectively memorizing their answers in a very compressed format with a very interesting adaptive compression algorithm. So for a AI, standardized tests are open book exams. But those questions are designed to challenge human students in closed book exams under human time constraints. So, who cares?
Where is my reasoning faulty?