3 ms·
I work in EdTech and here are my points: While AI detection software can easily have a false negative, it's much less likely to have a false positive. The ins
by nobrains 3y ago
I work in EdTech and here are my points:
While AI detection software can easily have a false negative, it's much less likely to have a false positive.
The instructor used 2 confirmations. Turnitin and the other tool. That makes the likely of false positive even lower.
The grammarly part is just a distraction from the main concern, which is whether the main portions of the paper were AI generated or not.
If I was the decision maker, I would count it against the student, HOWEVER, I would give a first warning, not academic probation.
I would also allow students to pass their papers through the exact same software (Turnitin) to pre screen their papers. Can this lead to students not being caught just by editng the parts which Turnitin thinks was generated? Yes, HOWEVER, it still makes the students work for that pass instead of them suddenly getting the axe.
- Kim_Bruning 3y agoHrrrm, this is counterintuitive to me. My own intuition would be to trust the AI-detection tools as much as AI (which is to say: only so much). However, it's early days. If you have a minute, can you explain in a little more detail why you believe these tools are reliable? (or what (may) make(s) them reliable, or reliable enough?) . And/or do you have a source that explains it? Or a place to start reading on why people think these tools are effective?
- DonsDiscountGas 3y agoDo you know of any published data evaluating the efficacy of these detectors? Because I've never seen any, so I'm curious how you know the false positive/false negative rates.
- anon373839 3y ago> While AI detection software can easily have a false negative, it's much less likely to have a false positive. To what extent does the software simply overfit on OpenAI’s house writing style? And to the extent that students may simply learn to imitate that writing style, what theoretical basis is there for this software having any validity?
- lupire 3y agoPeople in EdTech are the least credible speakers on this topic.