3 ms·
In my day job, I deal with the development of, and verifying the usefulness of, tests. The lesson here is that most tests are designed poorly. Most people don’
by KyeRussell 4y ago
In my day job, I deal with the development of, and verifying the usefulness of, tests.
The lesson here is that most tests are designed poorly. Most people don’t realise the effort that goes into doing it properly. Every item needs to be proven to be useful. Items that either purposely or accidentally ‘trick’ the test taker often prove to not be very useful when you run the stats. If a test ‘breaks the fourth wall’ like this, the item probably won’t stand on its own to be useful.
- ben_w 4y agoAh, that explains something I have been confused by for a while now without really understanding why. I'm learning German, and one of the apps I'm using is Clozemaster, where a sentence is missing a word and I have to fill in the gap. The easy mode is to choose from a list of four, the hard mode is to type in the word. Easy mode I can do fairly reliably without even fully reading the sentences, hard mode I struggle with — while the latter is partly because it only accepts one single specific word (so if the sentence would be valid with another word, e.g. weiß/blau/gold/schwarz, keine Punkte für mich if I pick the wrong correct answer), that alone didn't feel sufficient given the subjective experience of the difference between them. I think, from what you've said, in the easy mode I'm probably picking up on things that aren't as useful as I need.
- Nition 4y agoThank you. I've seen surveys where every question is a 'trick' question! Where the correct answer is always the non-intuitive one. Usually when the surveyor is trying put push an agenda and prove that you're wrong about something, but it just ends up being patronising if you realise the trick.