4 ms·
Am a university professor who frequently assigns essays, so this is something I've been thinking a lot about. The problem is not that AI can successfully write
by benbreen 7y ago
Am a university professor who frequently assigns essays, so this is something I've been thinking a lot about. The problem is not that AI can successfully write a college-level essay (maybe someday, but certainly GPT-2 isn't even close to that level yet). It's that something along the lines of GPT-2 can emulate the superficial appearance of an essay. The actual facts, quotes, and references it generates are generally nonsensical, but the structure, grammar and language seem authentic at first glance. Unfortunately, a lot of essays in university lecture courses are graded by underpaid TAs who are skimming quickly, and who might be inclined to give an AI-written essay a D or a C- for effort rather than recognizing it as fraud.
The issue isn't so much that AI has replaced essay writing. It's that it has the potential to create convincing (but fundamentally nonsensical/illogical) replicas of academic essays, which have the potential to make an already difficult job of assessment even harder (somewhat analogous to the problem of deepfakes).
By the way, I'm currently thinking about writing something on this topic; if anyone has any thoughts please get in touch. Contact info in my profile.
- analog31 7y ago>>> Unfortunately, a lot of essays in university lecture courses are graded by underpaid TAs who are skimming quickly, and who might be inclined to give an AI-written essay a D or a C- for effort rather than recognizing it as fraud. This raises an interesting point, which is that there seems to be a relationship between essay-writing and essay-reading. The students are able to cheat on essay-writing because the school is already cheating on essay-reading. If we reach a point where essay-writing is unnecessary because it can be done by machine, it's a safe bet that essay-reading will also be done by machine. What will be the point of writing me an essay, if it's just a function of a prompt? Why not just send me the prompt? Then professors will start to teach and assign the writing of prompts for essay-writing machines. "Write a prompt in less than 25 words that persuades analog31 to approve your project." And someone will come up with a prompt-writing machine, and a prompt-reading machine.
- g82918 7y ago>This raises an interesting point, which is that there seems to be a relationship between essay-writing and essay-reading. The students are able to cheat on essay-writing because the school is already cheating on essay-reading. When they pay so little why would a person spend hours reading and analyzing one essay. The bigger issue if the lack of resources devoted to grading and not that the people on the ground are cheating. edit: I think the commentator's emphasis should be on the lack of resources and not a supposed negligence on the grader's part.
- analog31 7y agoIndeed, I would say the system is cheating.
- cellular 7y agoI frequently wonder why the cost of college is rising while the teaching / grading is relegated to teacher assistants, and now, AI.
- ses1984 7y agoImagine a model trained just on college essays, and you feed it an outline. A sentence or two intro, some topic sentences, and citations. Probably if someone had a dataset of essays large enough, you could do this right now and cause a lot of trouble.