7 ms·
"Just not having any metric at all is far worse than the imperfect tests we have." Are you sure about that? How do you know that a bad metric is better than no
by kstenerud 14y ago
"Just not having any metric at all is far worse than the imperfect tests we have."
Are you sure about that? How do you know that a bad metric is better than no metric? It sounds a lot more like "We should be doing something. This is something. Therefore we should do it."
- justin_vanw 14y agoSure, I agree that in a general sense just pulling a number out of the air is crap. Testing isn't wrong, it's just not as correlated to the things we would actually like to measure as we would like it to be. This is an open problem in the world, and solving it (besides potentially making the inventor fabulously wealthy) would dramatically change the world. How do you decide if someone is qualified for a job, or will be successful at a university? In reality we don't have a very solid way to figure that out, so lots of people that would have done well are passed over and lots of people get into universities and hired for jobs and end up failing. Testing is correlated to lots of things, and is quite nicely correlated to the quality of the training a student was given. I'm sure there is a better solution out there in the aether, but mankind hasn't discovered it yet.
- greedo 14y agoActually, we do have a good way to determine how someone will perform. The US military has used the ASVAB test for decades, and studies have shown that performance correlates with test results. http://official-asvab.com/validity_res.htm http://official-asvab.com/validity_res.htm
- seanmcdirmid 14y agoTook the pre-asvab in high school back in the 90s, got a perfect score. The recruiters called a lot. Took the full ASVAB at a recruiting station, still got a very high score. Too easy, how can that be a real test? My ACT/SAT scores were good but not perfect.
- yummyfajitas 14y agoThis is a question about the philosophy of science. How do you know clinical trials are better than observational methods? How do you know controlled experiments are better than post-hoc reasoning and logical deduction? Standardized testing is just the application of the scientific method to education. If you don't believe in the scientific method then you shouldn't apply it here. But if you are asking for an empirical method to compare the scientific method to "other ways of knowing", there isn't one.
- deleted 14y ago[deleted]
- deleted 14y ago[deleted]
- vehementi 14y agoStandardized testing is an application of the scientific method to education, but it's (accurately) measuring stupid shit that we shouldn't care about in ways that are not relevant.
- klochner 14y agoWhat about long-run outcomes under standardized testing vs. without standardized testing? Longitudinal data would be difficult to find, but surely countries differ in their respective levels of standardized testing.
- wpietri 14y agoStandardized testing is just the application of the scientific method to education. That's not true in any way. The purpose of the education system is to create a well-informed citizenry prepared for a productive life and for the duty of running a country. The goal of standardized testing is to get some very rough metrics about superficial, easy-to-observe aspects of some basic parts of the apparatus. The two are very tenuously related. If we were applying the scientific method, we wouldn't be doing things like national, uncontrolled experiments that assume that basing major decisions on those rough metrics will result in improvements along the axes we actually care about. And then acting as if those metrics tell us everything about one aspect of the system, teachers, because that's where the political focus is. Applying the scientific method would involve formulating hypotheses and then testing them through lab work and field trials. That's what we do with medicine, at least some of the time. Heck, we could start by testing the hypothesis that getting everybody to focus lots of classroom time on standardized tests improves actual education.