3 ms·
> You build a statistical predictor of student performance (based on standardized test scores) then measure Performance = Avg(Actual - predicted). And then you
by Natsu 16y ago
> You build a statistical predictor of student performance (based on standardized test scores) then measure Performance = Avg(Actual - predicted).
And then you watch student performance get gamed by the teachers. There are all kinds of ways: turn a blind eye to cheating, move poor performers to others schools (including by getting them to graduate when they shouldn't), alter their tests (this is already being done under NCLB according to several news reports), ...
You're better off by having skilled teachers rate the other teachers. People aren't as easily gamed as systems of rules are.
- yummyfajitas 16y agoEasy solutions to your problems: "turn a blind eye to cheating" "alter their tests" Tests are given by independent proctors and designed by an independent agency. In much the same way, the DOD rates Halliburton's performance - it's not great, but it's better than Halliburton doing their own performance ratings. move poor performers to others schools (including by getting them to graduate when they shouldn't) Won't help with VAM. If you get rid of the poor performers, the predicted value of the people remaining will increase. Thus, you just made your job higher - the bar has been raised. People aren't as easily gamed as systems of rules are. I don't even know how to respond to this.
- Natsu 16y agoYour solution to fix education is to do things the way Haliburton & the DOD do? Yes, independent ratings can help, but at some point, if you can't trust anyone inside the system, you're screwed. And your results are exactly as good (or bad) as your ability to do ratings. Fancy math won't fixed a flawed premise, for example. We've been going for complex systems and simple people. Having good people and relatively simple systems, however, is the optimum from what I can see. I'm not opposed to the idea that accountability is needed, but the idea that you can go up to a troubled institution, make everyone's job harder, and then expect improvement is unrealistic in any industry. I'm not a teacher, but I've seen the effects of management like that first hand. Always taking the easy solution when managing something is not effective. >> People aren't as easily gamed as systems of rules are. > I don't even know how to respond to this. Obviously, I thought it implicit that I was talking about competent and experienced folks. Yes, if you get people who know nothing and put them in charge, you will have terrible results. They won't improve even if you give them a long list of rules to follow, which is how bureaucracy usually ends up.
- yummyfajitas 16y agoYour solution to fix education is to do things the way Haliburton & the DOD do? Would you prefer to do things the way the educational system does? Throw money at Halliburton and hope for the best? No outside auditors or performance measurements?
- Natsu 16y agoI thought I just said that I would prefer to hire highly competent teachers to do the evaluations. Not third parties, not politicians, and certainly not Haliburton or the DOD. Those who are competent ought to be able to recognize each other.