3 ms·
I think that vanilla GPT writes in a style that is easy to identify. There's also this "too-perfect" feel where in most forms of communication, most people make
by criley2 3y ago
I think that vanilla GPT writes in a style that is easy to identify. There's also this "too-perfect" feel where in most forms of communication, most people make mistakes. They splice commas, they use the wrong word, they subtly misspell something, they kinda lose their thought process, etc.
Especially as a teacher, you get used to seeing the, uh, quality of work that gets produced. I mean that for college teachers too. At my decent state college, the quality of essay writing was atrocious and I was given 99/100 for basically "not needing any help". In college!
When you compare the average GPT output to what many students turn in at all levels, the difference is highly apparent.
This also opens up the reality that smart cheaters will prompt engineer. I just tried on GPT4
> You are an average 10th grade student. You read and write at a 9th grade level. You don't edit your work ever and your writing has run-ons, comma splices, misuse of grammar, misspellings, etc. Say OK if you understand
> Write a 5 paragraph essay about spring bird patterns in Alabama. Use an intro paragraph and a conclusion paragraph. Keep it around 500 words.
> You are doing a good job of being a 10th grade student, however I want you to do the previous command like a 10th grade student who has been trained in basic essay writing and does not write conversationally.
And it's already producing something that is far more believable lol.
- hammyhavoc 3y agoThis would be much more interesting if you posted the output directly, or linked to a pastebin service with it on. The context is pretty key to deriving value from the comment.
- criley2 3y agoSure, I didn't want to spam large outputs here. https://pastebin.com/JcSHhzw8 https://pastebin.com/JcSHhzw8 For the record: these tools are open and available and it takes about 10 seconds for you to replicate my experiment. The value you derive from my comment should be the idea I give you, not the results I generated. My results are good but imperfect, and are the result of very little effort. Someone truly trying to cheat the system could produce way more I imagine.
- hammyhavoc 3y agoI am well aware that these tools are available, and perhaps if you paused for a moment, you might think that someone who already uses these tools might have hit their limit of requests for the next x period, or doesn't want to use limited resources recreating that which has already been done and is trying to better understand the context of your comment. Otherwise, why bother making the comment in such detail? The results you generated are as important as the idea because ChatGPT does not output the same thing every time. Sometimes the output is very useful, other times it is complete and utter drek. Method without results from that method are fairly meaningless if you're trying to compare.
- II2II 3y ago> Especially as a teacher, you get used to seeing the, uh, quality of work that gets produced. There was a time when I had to discuss a paper that was too well written with a student. The paper was too well written in both my eyes and the eyes of others. The student told me which journals they read and explained they read it for both content and style. Were they cheating? Perhaps. On the other hand, I have never encountered a cheat who cared enough to make it look like they cared about how they approach learning.
- zeroonetwothree 3y agoI got accused of cheating once in a college intro class because my paper was ‘too good’. They had no actual evidence, it’s just that I spent a lot of time on it. It really pissed me off and was one of the reasons I took only the bare minimum of non-math/engineering classes. In math no one ever accused me of cheating if I came up with a clever proof so it felt a lot more respectful.
- II2II 3y agoYeah, it is a very sad state of affairs when a genuine effort is considered suspect. The thing is, so few students put in the effort and many of those who you do talk to are upfront about expecting a certain grade. It very much taints the expectations on both sides of the fence.