3 ms·
The details at http://en.wikipedia.org/wiki/Turnitin http://en.wikipedia.org/wiki/Turnitin may be of thin help. At least one Canadian student has protested, and
by dalke 14y ago
The details at http://en.wikipedia.org/wiki/Turnitin http://en.wikipedia.org/wiki/Turnitin may be of thin help. At least one Canadian student has protested, and won. The number one point I took from it would be to advise her to not agree to the clickwrap license. Then she could at least protest about the abuse of her copyright.
If you two want to really stir things up, you can start a company which does text analysis of student essays and hire her with an exclusive contract to provide corpus material.
Some background for the company. "katengine.com" appears to be owned by Knowledge Analysis Technologies. http://www.forbes.com/forbes/1998/1228/6214047a_print.html http://www.forbes.com/forbes/1998/1228/6214047a_print.html has more info about the company, which was acquired in 2004 by Pearson Education http://kt.pearsonassessments.com/whyChooseUs.php http://kt.pearsonassessments.com/whyChooseUs.php .
If the teacher will be using the 'Intelligent Essay Assessor' from http://www.mywritinglab.com/learn-about/writing-practice.html http://www.mywritinglab.com/learn-about/writing-practice.htm... then yes, it's a variation of LSA, as you found. There's a fact sheet there with a picture of what the GUI might look like.
Based on that name, http://www.d.umn.edu/~tpederse/Courses/CS8761-FALL04/Project/Readme-SanLorenzo.html http://www.d.umn.edu/~tpederse/Courses/CS8761-FALL04/Project... says "This was developed in the late nineties by Tom Landauer and his team and is based on Latent Semantic Analysis. In this, using a matrix transformation technique known as Singular Value Decomposition (SVD), deeper hidden relationships between words and documents are discovered, and these relations are used to understand relation between words and sentences."
I found http://writing.ucdavis.edu/news-1/carl-whithaus-essay-published-in-measuring-writing http://writing.ucdavis.edu/news-1/carl-whithaus-essay-publis... which describes an essay critical about machine grading. I couldn't find that essay though.
http://www.huffingtonpost.com/2012/03/29/robo-readers-the-new-tea_n_1388227.html http://www.huffingtonpost.com/2012/03/29/robo-readers-the-ne... quotes: "A prankster could outwit many scoring programs by jumbling key phrases in a nonsensical order. An essay about Christopher Columbus might ramble on about Queen Isabella sailing with 1492 soldiers to the Island of Ferdinand -- and still be rated as solidly on topic, Shermis said." as well as "Computers also have a hard time dealing with experimental prose." So she might gum up the works by using an unusual but legitimate style.
Speaking of gumming up the works, I suppose that the essay must be submitted to the teacher in a text or word processor format? That is, hand-written or printed essays are prohibited? Or embedding a strange font which shows a "b" for "a", etc., and where the text is transposed accordingly? Pull quotes to throw off the formatting? Hidden text, colored white? That would be subterfuge.
Edit: Pearson also has "second-tier graders", says http://news.slashdot.org/comments.pl?sid=2757605&cid=39528641 http://news.slashdot.org/comments.pl?sid=2757605&cid=395... , with a human involved.
- aaron695 14y ago"A prankster could outwit many scoring programs by jumbling key phrases in a nonsensical order. An essay about Christopher Columbus might ramble on about Queen Isabella sailing with 1492 soldiers to the Island of Ferdinand -- and still be rated as solidly on topic, Shermis said." To be smart enough to prank on a subject and pass would mean a pretty in depth knowledge hence the mark would be correct. In fact a human would incorrectly say the student was bad at the subject so it makes the computer superior in marking students actual knowledge of the subject :)
- dalke 14y agoI don't agree. It seems to imply that a way around robo-graders is to list facts, and don't worry so much if the essay hangs together. In any case, your view and mine are hypothetical. I haven't seen an analysis of how well the system works in practice, or how easy it is to spoof. And it looks like it's the system at a whole which must be analyzed, if there's a second tier human layer which might review odd-ball papers.
- notahacker 14y agoAssuming there are existing lecture notes highlighting key information, you could probably pump them into the sort of "article spinners" used by SEO spammers and produce something that looked like accurate, original writing to a computer algorithm, without having any actual knowledge of the subject at all. Studying history (even at junior high school level in the UK) is more about interpreting sources and making reasoned arguments, than simply regurgitating facts and references. You can parrot or parody a list of facts and references you've been given whilst being a hopeless history student. Sounds like a machine comparing with a "model essay", meanwhile, would penalise those students foolish enough to construct original arguments and support them with reference material beyond the compulsory reading list.