3 ms·
"A prankster could outwit many scoring programs by jumbling key phrases in a nonsensical order. An essay about Christopher Columbus might ramble on about Queen
by aaron695 14y ago
"A prankster could outwit many scoring programs by jumbling key phrases in a nonsensical order. An essay about Christopher Columbus might ramble on about Queen Isabella sailing with 1492 soldiers to the Island of Ferdinand -- and still be rated as solidly on topic, Shermis said."
To be smart enough to prank on a subject and pass would mean a pretty in depth knowledge hence the mark would be correct.
In fact a human would incorrectly say the student was bad at the subject so it makes the computer superior in marking students actual knowledge of the subject :)
- dalke 14y agoI don't agree. It seems to imply that a way around robo-graders is to list facts, and don't worry so much if the essay hangs together. In any case, your view and mine are hypothetical. I haven't seen an analysis of how well the system works in practice, or how easy it is to spoof. And it looks like it's the system at a whole which must be analyzed, if there's a second tier human layer which might review odd-ball papers.
- notahacker 14y agoAssuming there are existing lecture notes highlighting key information, you could probably pump them into the sort of "article spinners" used by SEO spammers and produce something that looked like accurate, original writing to a computer algorithm, without having any actual knowledge of the subject at all. Studying history (even at junior high school level in the UK) is more about interpreting sources and making reasoned arguments, than simply regurgitating facts and references. You can parrot or parody a list of facts and references you've been given whilst being a hopeless history student. Sounds like a machine comparing with a "model essay", meanwhile, would penalise those students foolish enough to construct original arguments and support them with reference material beyond the compulsory reading list.