7 ms·
Shortest version. Francis Bacon was right, "Truth comes out of error more readily than out of confusion." Short version, they gave non-programmers a test befo
by btilly 17y ago
Shortest version. Francis Bacon was right, "Truth comes out of error more readily than out of confusion."
Short version, they gave non-programmers a test before they had learned anything. They found that people could be divided into those whose answers showed a consistent mental model, and those whose mental models from problem to problem were inconsistent. A followup administration of the same test partway in the course showed that the consistent/inconsistent description was stable, but consistent people's mental models improved. The distribution of scores for the final exam for the two groups looked like normal distributions with very different averages - most inconsistent thinkers failed while the consistent ones did ok.
When analyzed in more detail the final exam scores for the consistent thinkers had a bimodal distribution as well. However the test provided offered insight as to how to distinguish the average consistent thinkers (averaging 60% on the final) with the high scoring ones (averaging 85%). The sample sizes are small enough that I would not put too much weight on that observation though.
Amusingly people in the social sciences that they showed the results of the initial test to predicted that students who formed inconsistent mental models would do better because they tried to form the right model for each question. The cynical part of me says that they would have approached the test that way, and assumed that people like themselves would do better.