4 ms·

My intuition is that there must be some relatively simple ways to tweak the format of assignments or classes so that it's harder to use tools like ChatGPT to ch

My intuition is that there must be some relatively simple ways to tweak the format of assignments or classes so that it's harder to use tools like ChatGPT to cheat.

stefan_ 2y ago
The german way: do what you want during class, 90% of your score is from a final written exam, no multiple choice. (Of course the people that brought us the Scantron think that's too much work, but the reality is a normal institute can grade 500 exams in a weekend)
- gus_massa 2y ago
  I work in the first year of the university in Argentina and we grade 15.000 exams in a weekend (with a team of 300 T.A.)
- MattPalmer1086 2y ago
  Yep, that is how my degree was graded, a UK university. It was a distance learning course, but you had to physically attend an exam center and write your answers with pen and paper, no access to phones or computers.
LorenPechtel 2y ago
The basic problem is that most classwork is plowing the same ground over and over. "Generative AI" is really a glorified autocomplete--anything that's done over and over and over it will become able to do. You want to stop AI, you have to give the students novel assignments.
washadjeffmad 2y ago
I started suggesting this a few years ago, but to exploit their agreeableness, pre-write or have an LLM generate a paper for the students to correct. Additional points are awarded for expanding details and content or contributing improvements to formatting and style. This allows students to express their individual strengths while ensuring they also know how to properly proofread. Also, dock points for incorrect / non-existent citations. Alternatively, pre-select and provide sources without a topic, and let the students assemble a paper from them with no length requirement, but a citation minimum. While this may eventually be overcome with RAG and summarization, it's a weakness of current models.

My intuition is that there must be some relatively simple ways to tweak the format of assignments or classes so that it's harder to use tools like ChatGPT to cheat.

stefan_ 2y ago

The german way: do what you want during class, 90% of your score is from a final written exam, no multiple choice. (Of course the people that brought us the Scantron think that's too much work, but the reality is a normal institute can grade 500 exams in a weekend)

gus_massa 2y ago
I work in the first year of the university in Argentina and we grade 15.000 exams in a weekend (with a team of 300 T.A.)
MattPalmer1086 2y ago
Yep, that is how my degree was graded, a UK university. It was a distance learning course, but you had to physically attend an exam center and write your answers with pen and paper, no access to phones or computers.

LorenPechtel 2y ago

The basic problem is that most classwork is plowing the same ground over and over. "Generative AI" is really a glorified autocomplete--anything that's done over and over and over it will become able to do. You want to stop AI, you have to give the students novel assignments.

washadjeffmad 2y ago

I started suggesting this a few years ago, but to exploit their agreeableness, pre-write or have an LLM generate a paper for the students to correct. Additional points are awarded for expanding details and content or contributing improvements to formatting and style. This allows students to express their individual strengths while ensuring they also know how to properly proofread. Also, dock points for incorrect / non-existent citations. Alternatively, pre-select and provide sources without a topic, and let the students assemble a paper from them with no length requirement, but a citation minimum. While this may eventually be overcome with RAG and summarization, it's a weakness of current models.