3 ms·
A quote from the article: “My first and greatest objection to the research is that they did not have any valid statistical test comparing the software directly
by a_p 14y ago
A quote from the article:
“My first and greatest objection to the research is that they did not have any valid statistical test comparing the software directly to human graders,” said Mr. Perelman.
That is a good enough reason not to use the software. If it does eventually pass such a test, I doubt that it would ever be better than the best human grader but rather it would be better than the average grader.
- SilasX 14y agoI'm not sure a "good" result for such software would be much progress though -- any success would be the result of students writing for a human grader. If you actually employ the software grader, students write with that in mind and start looking for "tricks" and "holes" in the algorithm that result in a good grade but diverge from what we humans regard as good writing.
- Retric 14y agoYour assuming 100% automation, having a person skim for obvious bad faith essays is probably enough to combat such cheating while still saving 90% of the effort of fulling grading each essay.