2 ms·
Before addressing the difficulty factor, the testing companies should be refining the testing methods to better judge student mastery of the subject matter rath
by logfromblammo 12y ago
Before addressing the difficulty factor, the testing companies should be refining the testing methods to better judge student mastery of the subject matter rather than their test-taking ability.
This involves automated production of questions unique to a particular test-taker, and automated scoring of the answers.
Once that has been done, the difficulty of the test can even be adjusted on the fly to better determine the exact ability level of the student. Rather than having separate static tests for an expected range of ability levels, everything from preschool readiness to SAT and GRE equivalents can be tested by the same software.
If a child takes state-mandated standardized tests, and it shows a perfect score in math, the teachers may put that student in the most advanced math class taught at that grade level. But what if the test could show that the student's ability exceeded that of the typical student four or five years older, without becoming less precise for typical students the same age?
It's really a shame that standardized tests haven't yet evolved beyond multiple choice answers for human-written questions and scored by machines with optical scanners. But in general, I do think that test should be harder. They should be so hard that no one can achieve a perfect score, even by chance. And they should also be so easy that no one can score zero. It's the only way to get a good idea of the population distribution of the people you are testing.
- Torgo 12y ago>It's really a shame that standardized tests haven't yet evolved beyond multiple choice answers for human-written questions and scored by machines with optical scanners. They have somewhat, it's called adaptive, or "branched" testing. It is a computer-based test that gives you progressively harder questions to find the limit of your abilities and when you get them wrong it drops the difficulty again in an attempt to try to find out exactly where your knowledge drops off. That's an extremely oversimplified explanation, but you can read the Wikipedia article, which is OK: https://en.wikipedia.org/wiki/Computerized_adaptive_testing https://en.wikipedia.org/wiki/Computerized_adaptive_testing The problem is money, and to be honest, the motivations of who is buying the test (for some clients the testing is just meant to be a professional barrier to entry or to do the bare minimum to comply with a government requirement.) I worked in standardized testing for almost a decade on nearly every kind of test, helping psychometricians and test administrators, so I saw a lot of bad and good tests.