4 ms·
I suspect this test gives central values to many test-takers because the internal consistency of the questions has not been verified. Anyone can come up with t
by kqr 1y ago
I suspect this test gives central values to many test-takers because the internal consistency of the questions has not been verified.
Anyone can come up with ten questions and claim "these measure a programmer's fondness for abstraction". Unfortunately, we cannot verify this claim. What we can do is check statistically if the answers to the ten questions correlate strongly enough that we think they measure the same thing, whatever that is.
This involves a trial run of the quiz followed by statistics such as Cronbach's alpha and principal componoment analysis. Often one finds that the questions do not measure the same thing at all! It is difficult to come up with a set of internally consistent questions.
When we add together inconsistent questions (as is done here to get the final score), we don't get stronger signal: the noise from the uncorrelated questions cancels out and almost everyone gets a result near zero.
I know OP is not the author, but if the author reads this: if you're lucky, the data from this audience mey reveal a subset of two or three questions per dimension that are internally consistent. Use only those in the quiz going forward! Then you can trial more questions one at a time and keep only those that are consistent with the first set. (Is this not p-hacking? Yes but in this context who cares.)
- BrissyCoder 1y ago> I suspect this test gives central values to many test-takers because the internal consistency of the questions has not been verified. Do you prefer to use: 1. Capital letters 2. Lower-case letters 3. Numbers 4. The characters required for the text I am writing to be correct and legible
- simpaticoder 1y agoI came here to write a similar comment. To me it read more like: When driving, do you prefer to a) turn left, b) turn right, c) press the gas pedal, d) press the brake pedal, or e) execute a sequence of actions that get you safely to your destination? There's a good idea here, perhaps, but it's obscured by very weak questions.
- eterm 1y agoThe graph also seems broken, because I got +2 absract, +10 human-friendly but when plotted, the +10 appeared near the axis anyway. The graph is would be better plotted with the radius representing standard-deviation or some other measure rather than the raw score.