9 ms·
I'll be concrete and define "game standardized tests" as "aspects which influence the test results other than proficiency in the subject matter." On the teache
by dalke 12y ago
I'll be concrete and define "game standardized tests" as "aspects which influence the test results other than proficiency in the subject matter."
On the teacher side, one way to game them is via test prep. Quoting from http://curmudgucation.blogspot.com/2014/04/what-test-prep-is-not.html http://curmudgucation.blogspot.com/2014/04/what-test-prep-is... : "learning how to perform the specific cockamamie tasks favored by the designers of the various state-level assessments"
That includes:
> We have covered "How To Spot the Fake Answers Put There To Fool You." We've discussed "Questions About Context Clues Mean You Must Ignore What You Think You Know." We've discussed how open-ended questions require counting skills (the answer to any question that includes "Give three reasons that..." just requires a full three reasons of anything at all, but give three). For lower-function students, we covered such basics as "Read All Four Answers Before You Pick One."
> We have pushed aside old literary forms like "short stories" and "novels" in favor of "reading selections"-- one-page-sized chunks of boring contextless pablum which nobody reads in real life, but everybody reads on standardized tests. We have taught them to always use big words like "plethora" on their essay answers, and to always fill up the whole essay page, no matter what repetitive gibberish is requires. We have taught them to always rewrite the prompt as their topic sentence. In PA, we have taught them what sort of crazy possible meaning the test-writers might have assigned to the words "tone" and "mood."
This is gaming the system because had the test givers used a completely different approach, say, of using open-ended questions instead of multiple-choice answers, or "give persuasive reasons that..." instead of the more easily tested "three", then this test prep would not work. Not that that alternate testing form will happen in standardized tests, because it's a lot more expensive to grade free-form tests. But teachers themselves can ask these sorts of questions, to help gauge proficiency.
Another way to game the test is on the test giver's side - they get to define what the pass/fail thresholds are. For example, "a test question was considered "hard" or "easy" not because it required a particular skill; its difficulty was determined based on how many students got it correct." Quote from http://jerseyjazzman.blogspot.com/2013/08/scoring-ny-tests-with-triple-lindy.html http://jerseyjazzman.blogspot.com/2013/08/scoring-ny-tests-w... .
Since the thresholds can be determined after the fact, this means it's not really judging proficiency but instead is making the test give a pre-defined pass/fail curve.
- yummyfajitas 12y ago"How to spot the fake answers put there to fool you" == "how to see when an answer isn't even in the ballpark". That's a useful skill. That "context clues" thing suggests teaching students how to solve the problem in front of them, not the easy problem their mind wants to substitute for it [1]. From what this guy describes, "test prep" sounds like "educating students". I agree that grading of essays is a disaster. It's not specific to standardized tests, however - that's how all my essays were graded from grade 1 all the way to college. Another way to game the test is on the test giver's side - they get to define what the pass/fail thresholds are. This is why tests are standardized, not left up to the schools or teachers. [1] A hard problem: "What is the optimal incarceration time to dissuade people from pedophilia." An easy problem: "How angry do pedophiles make me feel?" When most people hear the first question, which is hard, their mind substitutes the second much easier question for it. See Kahneman's book "Thinking Fast and Slow" for more on this. http://www.amazon.com/gp/product/0374533555/ref=as_li_tl?ie=UTF8&camp=1789&creative=390957&creativeASIN=0374533555&linkCode=as2&tag=christuc-20&linkId=KWB55KZLPEI4OQCE http://www.amazon.com/gp/product/0374533555/ref=as_li_tl?ie=...
- rando289 12y ago> From what this guy describes, "test prep" sounds like "educating students". It's educating them in the wrong things. For example, goal of class: better thinker by learning to do multiplication. Because of test, they only learned memorizing multiplication tables.
- yummyfajitas 12y agoThe tests ask for multiplying 3 digit numbers. That's a lot of memorizing.
- octo_t 12y agothat was a simple example. A better example might be memorizing quotes from a book to regurgitate in the test* * (I had to do this as part of GCSE English in the UK - I expect a similar situation in the US)