5 ms·

Perhaps there is more to this story. Has the student posted her paper? She claims she only used it "to fix spelling and punctuation errors, not to create or ed

Perhaps there is more to this story. Has the student posted her paper? She claims she only used it "to fix spelling and punctuation errors, not to create or edit content" But how would an plagiarism detector pick up that she fixed spelling and punctuation mistakes using grammarly? If she never made those mistakes in the first place, and didn't use grammarly at all, shouldn't the detector still call it AI generated? So, this story is either about an AI detector that detects human writing as AI, or it is about a lady lying about to what extent she used AI to write her paper. Or maybe the university is spying on what extensions are installed on student laptops, or sniffing network requests, I don't know. On a final note, is it cheating if I let a friend proofread my paper and offer me suggestions? Why would AI be any different? Clearly it is cheating if my friend actually writes the paper for me, as it would be if AI wrote the paper for me.

Kim_Bruning 3y ago
AFAIK AI detectors are about as reliable as the AI they're supposed to detect. This state is shifting as AI improves, and is unlikely to ever theoretically hit 100% correctness (but may ultimately theoretically hit 0% correctness) . At best you can may be able to use such a detection as a flag to prompt further investigation. This much may or may not be warranted based on the state of AI detection at point X in time. However, you should not use AI detection software alone to serve as proof or disproof.
- kelipso 3y ago
  I'm guessing a coin toss is closer to what Grammarly does and that would get you 50% accuracy haha.
ryandrake 3y ago
The burden of proof should be very high if you're going to wreck someone's academic career and send them to the dean of student integrity. "Computer Says It's AI" shouldn't cut it. A good lawsuit precedent is needed to smack down these guilt-or-innocent black boxes.
watwut 3y ago
> But how would an plagiarism detector pick up that she fixed spelling and punctuation mistakes using grammarly? These detectors produce tons of false positives all the time. You really can not conclude much from the fact that it detected something.

Kim_Bruning 3y ago

AFAIK AI detectors are about as reliable as the AI they're supposed to detect. This state is shifting as AI improves, and is unlikely to ever theoretically hit 100% correctness (but may ultimately theoretically hit 0% correctness) . At best you can may be able to use such a detection as a flag to prompt further investigation. This much may or may not be warranted based on the state of AI detection at point X in time. However, you should not use AI detection software alone to serve as proof or disproof.

kelipso 3y ago
I'm guessing a coin toss is closer to what Grammarly does and that would get you 50% accuracy haha.

ryandrake 3y ago

The burden of proof should be very high if you're going to wreck someone's academic career and send them to the dean of student integrity. "Computer Says It's AI" shouldn't cut it. A good lawsuit precedent is needed to smack down these guilt-or-innocent black boxes.

watwut 3y ago

> But how would an plagiarism detector pick up that she fixed spelling and punctuation mistakes using grammarly? These detectors produce tons of false positives all the time. You really can not conclude much from the fact that it detected something.