3 ms·
I wonder what limitations there are to using standardized testing for evaluating "progress"? Any heuristic you care to use is significantly better than the tra
by patio11 17y ago
I wonder what limitations there are to using standardized testing for evaluating "progress"?
Any heuristic you care to use is significantly better than the traditional metric for school quality, which is spending per pupil. (This metric was selected because optimizing for it optimizes for the outcomes teachers unions desire. American public school exist to employ union teachers and sometimes cause education as an industrial biproduct.)
This puts me in mind of the metric my day job used to track productivity for several decades: hours worked by the engineering staff. That one had perverse consequences, too. (Having a bad quarter? Need a good statistic to report to the head office? Start a deathmarch!)
- wisty 17y agoGoodheart's Law (not to be confused with Godwin or Murphy's Laws): "any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes". Randall Munroe (xkcd) has make a similar observation.
- RyanMcGreal 17y agoAs soon as you start measuring something and attaching organizational outcomes to the results, you encourage gaming.
- tokenadult 17y agoAs above, better that what people are pursuing is student learning than spending per school.