3 ms·
That is correct - the authors themselves failed to replicate the results. I kept some notes over the years (saw this OP in 2006); from http://www.gwern.net/Note
by gwern 15y ago
That is correct - the authors themselves failed to replicate the results. I kept some notes over the years (saw this OP in 2006); from http://www.gwern.net/Notes#the-camel-has-two-humps http://www.gwern.net/Notes#the-camel-has-two-humps
...replications of the test have had issues; from http://crpit.com/confpapers/CRPITV78Bornat.pdf http://crpit.com/confpapers/CRPITV78Bornat.pdf:
> "We now report that after six experiments, involving more than 500 students at six institutions in three countries, the predictive effect of our test has failed to live up to that early promise.”
And http://www.eis.mdx.ac.uk/research/PhDArea/saeed/SD_PPIG_2009.pdf http://www.eis.mdx.ac.uk/research/PhDArea/saeed/SD_PPIG_2009...
> “A test was designed that apparently examined a student’s knowledge of assignment and sequence before a first course in programming but in fact was designed to capture their reasoning strategies. An experiment found two distinct populations of students: one could build and consistently apply a mental model of program execution; the other appeared either unable to build a model or to apply one consistently. The first group performed very much better in their end-of-course examination than the second in terms of success or failure. The test does not very accurately predict levels of performance, but by combining the result of six replications of the experiment, five in UK and one in Australia. We show that consistency does have a strong effect on success in early learning to program but background programming experience, on the other hand, has little or no effect.”