7 ms·

The problem with such things is that you would need 100% accuracy in most cases for it to be useful. For example many schools and universities fear that student

by spoork 4y ago

The problem with such things is that you would need 100% accuracy in most cases for it to be useful. For example many schools and universities fear that students use ChatGPT for homework. If such a plagiarism checker has false positive results in just a small percentage of cases, the consequences for honest students would be too severe to actually act on the results of the check. But perfect accuracy can never be reached for text classification, so those tool will never be that useful despite being interesting to AI people.

dogma1138 4y ago
That’s a very naïve outlook in reality like with every system the burden of proof would end up falling on the accused not the accuser…
- another-dave 4y ago
  What could that burden of proof look like? Not sure how a student could prove that the negative, apart from videotaping themselves writing the essay, or only being allowed type it on an airgapped machine owned by the university. Doesn't feel very feasible to implement.
  - avereveard 4y ago
    and if the student is not a complete tool, he can definitely learn the output and replicate it very, very closely
  - lupire 4y ago
    Even before GPT, schools should require students to submit derailed outlines and notes of their work. For one, students need to learn these skills. For two, it helps protect against more plagiarism and cheating.
- j_french 4y ago
  The reality in my experience (as a university lecturer) is that the burden of proof very much falls on the accuser rather than the accused.
  - dogma1138 4y ago
    How is that? Students already are required to submit a lot of evidence with their work such as research notes, plans, lab work etc. to prove they’ve actually done that and if plagiarism detection systems flag any of their work they have to defend it rather than the institution having to investigate and build evidence on its own outside of w/e shoddy plagiarism detection system they bought told them.
Nanana909 4y ago
> The problem with such things is that you would need 100% accuracy in most cases for it to be useful. Why? If there is 75% confidence a students report was generated using ChatGPT, then that’s enough to sit down with the student and discuss the content in person and see if they actually know it. A tool such as this could help the teacher having to avoid doing this with every student, and also reinforce to students that if they don’t actually know the material there’s still a chance they get caught. > the consequences for honest students would be too severe to actually act Only if acting is immediately accusing them of plagiarism rather than working with the student to ensure it’s really their work.
- avereveard 4y ago
  This is not what is going to happen tho. Flagged content will not be accepted and the student failed for the class, or worse for the year. Expulsion is on the card as the war against generated content becomes bitter.
  - lupire 4y ago
    No university will expel a student without evidence. One tried and lost a $1.5M lawsuit. https://people.com/human-interest/twins-defamation-lawsuit-medical-school-alleged-cheated-exam/ https://people.com/human-interest/twins-defamation-lawsuit-m...
- dns_snek 4y ago
  This is such a short-sighted view. Students who wish to cheat using ChatGPT will immediately start running their text through these tools preemptively, changing some phrases here and there and add spelling errors to ensure they don't get caught. You're left with innocent students being accused of cheating on regular basis. Maybe the education system will finally learn that asking students to merely recite information that can be found by anyone, anywhere, in less than 10 seconds isn't helpful in judging their understanding of the subject, except in very limited scenarios.
  - Nanana909 4y ago
windexh8er 4y ago
This seems to be a reductive response to a confidence based policy approach. There are many systems out there today that provide a confidence score of bots vs humans. I happen to work with a product that uses this exact approach and it's highly effective. So with education scenarios I think that the teacher/professor/administration will use these systems to inspect the entirety of the submissions. From there a baseline value will be derived and from there outliers will appear that may require deeper analysis/interview. Schools are in the position that they can't get it wrong more often than not (they need tuition dollars after all), but a severe detractor will need to be hanging over the heads of students to avoid cheating with it. I think the other thing we'll see is a nanny state approach by some educational institutions. Falling in a trap of being sold on software to "block" or "monitor" students using these tools. It would be easy to implement on a campus network to a certain extent (correlating student network login to URL accessed and potentially MitM) but the reality is smart students will know better and will use phone hotspots and VPN. The other dark side to consider is that the owners of ChatGPT could provide logs of user accounts and queries to higher education as a service. At the end of the day my guess is all approaches are going to be tested at some level. But the cat is out of the bag and this is going to generate some very interesting countermeasure solutions/approaches along the way.
anyonecancode 4y ago
At the university level, the problem of cheating is more a problem with our idea of a university. In an ideal world, you go to a university to learn. If someone wants to cheat, ultimately they're just cheating themselves (and, if at a private university or even most public universities, throwing a lot of money away). "Cheating" isn't really the university's problem in that view. Ofc, in reality universities aren't (or not only, and in most cases not primarily) about learning, but about credentialism. Employers and various social systems outsource to universities the role of verifying that people actually know something, or are the "right" sort of person, or other signals. I don't know how one goes about fixing that, or if it's even possible, but I'd like to see more acknowledgement of it. Fixing "cheating" feels like the equivalent of looking to clever programming to fix product bugs.
- lupire 4y ago
  Universities should stop issuing transcripts and diplomas that they refuse to guarantee. They are complicit in a fraud against employers.
  - jstarfish 4y ago
    That's on employers for putting too much faith in educational institutions. It's like expecting a guarantee from the church that all their exorcisms render the host demon-free. A degree is an artifact of a belief system. That there are credentialed idiots among us means the belief system itself is flawed.
- TillE 4y ago
  You don't really need any radical changes, you just have to get rid of the idea of graded homework, which I always hated from elementary school onwards. Larger projects have a role to play in education, but ultimately if you can't pass the proctored exams, you don't pass the course.
- deleted 4y ago
  [deleted]
- esfandia 4y ago

by spoork 4y ago

dogma1138 4y ago

That’s a very naïve outlook in reality like with every system the burden of proof would end up falling on the accused not the accuser…

another-dave 4y ago
What could that burden of proof look like? Not sure how a student could prove that the negative, apart from videotaping themselves writing the essay, or only being allowed type it on an airgapped machine owned by the university. Doesn't feel very feasible to implement.
- avereveard 4y ago
  and if the student is not a complete tool, he can definitely learn the output and replicate it very, very closely
- lupire 4y ago
  Even before GPT, schools should require students to submit derailed outlines and notes of their work. For one, students need to learn these skills. For two, it helps protect against more plagiarism and cheating.
j_french 4y ago
The reality in my experience (as a university lecturer) is that the burden of proof very much falls on the accuser rather than the accused.
- dogma1138 4y ago
  How is that? Students already are required to submit a lot of evidence with their work such as research notes, plans, lab work etc. to prove they’ve actually done that and if plagiarism detection systems flag any of their work they have to defend it rather than the institution having to investigate and build evidence on its own outside of w/e shoddy plagiarism detection system they bought told them.

Nanana909 4y ago

> The problem with such things is that you would need 100% accuracy in most cases for it to be useful. Why? If there is 75% confidence a students report was generated using ChatGPT, then that’s enough to sit down with the student and discuss the content in person and see if they actually know it. A tool such as this could help the teacher having to avoid doing this with every student, and also reinforce to students that if they don’t actually know the material there’s still a chance they get caught. > the consequences for honest students would be too severe to actually act Only if acting is immediately accusing them of plagiarism rather than working with the student to ensure it’s really their work.

avereveard 4y ago
This is not what is going to happen tho. Flagged content will not be accepted and the student failed for the class, or worse for the year. Expulsion is on the card as the war against generated content becomes bitter.
- lupire 4y ago
  No university will expel a student without evidence. One tried and lost a $1.5M lawsuit. https://people.com/human-interest/twins-defamation-lawsuit-medical-school-alleged-cheated-exam/ https://people.com/human-interest/twins-defamation-lawsuit-m...
dns_snek 4y ago
This is such a short-sighted view. Students who wish to cheat using ChatGPT will immediately start running their text through these tools preemptively, changing some phrases here and there and add spelling errors to ensure they don't get caught. You're left with innocent students being accused of cheating on regular basis. Maybe the education system will finally learn that asking students to merely recite information that can be found by anyone, anywhere, in less than 10 seconds isn't helpful in judging their understanding of the subject, except in very limited scenarios.
- Nanana909 4y ago

windexh8er 4y ago

This seems to be a reductive response to a confidence based policy approach. There are many systems out there today that provide a confidence score of bots vs humans. I happen to work with a product that uses this exact approach and it's highly effective. So with education scenarios I think that the teacher/professor/administration will use these systems to inspect the entirety of the submissions. From there a baseline value will be derived and from there outliers will appear that may require deeper analysis/interview. Schools are in the position that they can't get it wrong more often than not (they need tuition dollars after all), but a severe detractor will need to be hanging over the heads of students to avoid cheating with it. I think the other thing we'll see is a nanny state approach by some educational institutions. Falling in a trap of being sold on software to "block" or "monitor" students using these tools. It would be easy to implement on a campus network to a certain extent (correlating student network login to URL accessed and potentially MitM) but the reality is smart students will know better and will use phone hotspots and VPN. The other dark side to consider is that the owners of ChatGPT could provide logs of user accounts and queries to higher education as a service. At the end of the day my guess is all approaches are going to be tested at some level. But the cat is out of the bag and this is going to generate some very interesting countermeasure solutions/approaches along the way.

anyonecancode 4y ago

At the university level, the problem of cheating is more a problem with our idea of a university. In an ideal world, you go to a university to learn. If someone wants to cheat, ultimately they're just cheating themselves (and, if at a private university or even most public universities, throwing a lot of money away). "Cheating" isn't really the university's problem in that view. Ofc, in reality universities aren't (or not only, and in most cases not primarily) about learning, but about credentialism. Employers and various social systems outsource to universities the role of verifying that people actually know something, or are the "right" sort of person, or other signals. I don't know how one goes about fixing that, or if it's even possible, but I'd like to see more acknowledgement of it. Fixing "cheating" feels like the equivalent of looking to clever programming to fix product bugs.

lupire 4y ago
Universities should stop issuing transcripts and diplomas that they refuse to guarantee. They are complicit in a fraud against employers.
- jstarfish 4y ago
  That's on employers for putting too much faith in educational institutions. It's like expecting a guarantee from the church that all their exorcisms render the host demon-free. A degree is an artifact of a belief system. That there are credentialed idiots among us means the belief system itself is flawed.
TillE 4y ago
You don't really need any radical changes, you just have to get rid of the idea of graded homework, which I always hated from elementary school onwards. Larger projects have a role to play in education, but ultimately if you can't pass the proctored exams, you don't pass the course.
deleted 4y ago
[deleted]
esfandia 4y ago