4 ms·

It might be that you do not know what you do not know. Yes, you’ll notice some stupid cheaters, but you might not catch everything. I can see why you believe i

by tlogan 3y ago

It might be that you do not know what you do not know. Yes, you’ll notice some stupid cheaters, but you might not catch everything. I can see why you believe identifying GPT-generated text is easy. This is because techniques like prompt engineering, few-shot learning, and fine-tuning aren't known and used extensively yet. For instance, with a 32k model, you could input all your previous writings and the instruct gpt to mimic your style—even down to the grammar mistakes.

gochi 3y ago
>you could input all your previous writings and the instruct gpt to mimic your style—even down to the grammar mistakes. This requires having a massive amount of previous writings to input, otherwise gpt struggles actually differentiating styles enough to generate it consistently in the same way a human would. Most students do not have enough personal writing data to train from. This also excludes other strategies, such as getting every student to write on paper in a supervised environment and using this to guide your pattern assessments of submitted electronic works. It's very difficult for people to remain consistent and implement their own style in gpt generation. You can ask the many creative writers who are trying to use gpt for stories, and how many of them have to treat generation as an extreme rough draft of plot points at best.
horsawlarway 3y ago
This was my take. I think absolutely anyone claiming that detecting LLM generated text is easy is flat out lying to themselves, or has only spent a few tokens and very little time playing with it. Take semi-decent output, give it a single proof read and a few edits... and I don't fucking believe anyone who says they'll detect it. They absolutely will detect some of the most egregious examples of it, but assuming that's all of it is near willfully naive at this point.
synxos 3y ago
I am a chatGPT4 fanatic but college students I have talked to have all said the same thing. They aren't going to risk getting expelled. Schools have done a good job of putting the fear of God into kids to not use chatGPT. Better to just not turn a paper in than to be accused of plagiarism. All chatGPT shows to me is we have a ton of smart, incredibly closed minded people that know what they know and they think they have it all figured out. My paper would be easy to spot if chatGPT helped because the writing would be so much better. The thoughts would be much better organized.

by tlogan 3y ago

gochi 3y ago

>you could input all your previous writings and the instruct gpt to mimic your style—even down to the grammar mistakes. This requires having a massive amount of previous writings to input, otherwise gpt struggles actually differentiating styles enough to generate it consistently in the same way a human would. Most students do not have enough personal writing data to train from. This also excludes other strategies, such as getting every student to write on paper in a supervised environment and using this to guide your pattern assessments of submitted electronic works. It's very difficult for people to remain consistent and implement their own style in gpt generation. You can ask the many creative writers who are trying to use gpt for stories, and how many of them have to treat generation as an extreme rough draft of plot points at best.

horsawlarway 3y ago

This was my take. I think absolutely anyone claiming that detecting LLM generated text is easy is flat out lying to themselves, or has only spent a few tokens and very little time playing with it. Take semi-decent output, give it a single proof read and a few edits... and I don't fucking believe anyone who says they'll detect it. They absolutely will detect some of the most egregious examples of it, but assuming that's all of it is near willfully naive at this point.

synxos 3y ago

I am a chatGPT4 fanatic but college students I have talked to have all said the same thing. They aren't going to risk getting expelled. Schools have done a good job of putting the fear of God into kids to not use chatGPT. Better to just not turn a paper in than to be accused of plagiarism. All chatGPT shows to me is we have a ton of smart, incredibly closed minded people that know what they know and they think they have it all figured out. My paper would be easy to spot if chatGPT helped because the writing would be so much better. The thoughts would be much better organized.