5 ms·
There's a Tool to Catch Students Cheating with ChatGPT.OpenAI Hasn't Released It
- Bostonian 2y agohttps://archive.is/pV9p9 https://archive.is/pV9p9 This was funny: 'Last year, Josh McCrain, a political-science professor at the University of Utah, gave students a writing assignment that included, in indecipherable small text, instructions to include a reference to Batman. If they copy and pasted the assignment into AI, the instructions would be incorporated. Sure enough, a handful of students turned in papers with nonsensical references to Batman. Going forward, McCrain is tweaking writing assignments to focus more on current events AI is less familiar with and beseeching students not to outsource their work to AI.'
- viraptor 2y agoI found some things weird in the article. > Technology that can detect text written by artificial intelligence with 99.9% certainty Ok, but what's the accidental match rate? They're essentially proposing a filter where some token combinations wouldn't occur. With that you can say a text was likely written by OpenAI, but it doesn't say how likely it was written by a human. > Our ability to defend our lack of text watermarking is weak now that we know it doesn’t degrade outputs Apart from structured output with strictly expected contents. For example you couldn't extract done paragraph from the given text into Json. It would have to get changed in some way to match the allowed token filter.
- deleted 2y ago[deleted]