8 ms·

Just to throw it out there, I graduated during the pandemic, and it was so frustrating not only the amount of cheating that occurred, which meant that if you di

Just to throw it out there, I graduated during the pandemic, and it was so frustrating not only the amount of cheating that occurred, which meant that if you didn't cheat you fell behind; but also how professors responded. I had a few professors who made exams ridiculously hard with strict time limits, just because they expected people to cheat. So the exams were designed in a way they cheating was the only way to get through it, which just encouraged more people to cheat. Not to say every person cheated, or every professor designed tests to be harder, but both groups were larger than you'd expect. The good news is I think that with classes being in person again things will go relatively back to normal. Honestly I don't think I can fault students who cheated during the pandemic, it was just so abnormal that most people did whatever they had to to cope.

tppiotrowski 5y ago
Does anyone in academia know if tests are designed on a curve? You can give a test that everyone gets 100% on (assuming they show up) and you can give a test that everyone fails. Is part of creating a test thinking about how many students in your class are capable of scoring A’s, etc or is it just a side effect
- mikepurvis 5y ago
  I had a highschool calculus teacher who was very explicit about designing their tests on an A/B/C system. The idea was that the A section was the basic plug-n-chug versions of the problem that everyone should be able to get if you were even half paying attention in class; the B section is stuff that requires a bit more reasoning and analysis, and may have a pitfall or two, but they'll be things that were at least mentioned; and the C section is effectively extra credit— a problem where you needed to have a deeper understanding in order to figure out something novel about it, or like you needed to re-derive something from first principles in a way that was slightly different from what was shown in class, that kind of thing. And the sections weren't equally weighted; I think it was usually like 50/30/20, or even 60/30/10. Some people hated this, but I really liked how explicit it was. There was no mystery meat— the whole evaluation scheme was very open about its design and intent.
- denimnerd42 5y ago
  From my experience... it varies widely. The university will have a standard, the department will, the professor will. I had experience taking undergraduate courses at 4 institutions in the USA and of course many departments. I had some professors that expected the grades to fall like grade school did with 90-100 % being a high percentage. Others gave 4-6 difficult multi part problems and graded on a transparent curve. Others gave difficult problems and were not transparent about the grading scheme.
- corty 5y ago
  Depends on country, university and professor. In Germany, the general rule is that grading on a curve isn't allowed or at least strongly discouraged. There was a short while when such a system was acceptable, called ECTS grades (not to be confused with ECTS credits), but that was done away with in a year or so. Currently, grades are based on the lecture contents and the expectation of the lecturer for the progress a student should make. Lecturers are relatively free to do whatever they please within those bounds. If a test ends in everybody failing, tough luck, maybe next time. If that unfortunate event does repeat too often, the dean might get involved, but can't do a lot more than talk to the lecturer.
- nextlevelwizard 5y ago
  If school is using grading curves that school has already failed and there is no saving it before grading system changes.
- allgreed 5y ago
  Not strictly curve grading, but when I was studying electronics one of the professors had a 9-step algorithm for processing raw scores into grades. That involved normalizing the lab scores between different reviewers (so that harshness of a particular reviewer would be compensated for). He also assigned `cos(percentage_from_other_test as radians)` instead of resits if you missed one of the tests for valid reason but had shown up on the other. On one hand I really like the former approach and could understand the latter (organizing resits is likely a huge PITA). On the other that's the only professor I heard of that was attacked with an axe by one of his students.
  - cutemonster 5y ago
    > only professor I heard of that was attacked How did that end, if it's not too weird to ask > normalizing the lab scores between different reviewers Sounds like a good idea to me :-)
cowpig 5y ago
I had an experience like this in Numerical Methods in university years ago. The exams were incredibly difficult for bad reasons: you had to calculate many iterations of an algorithm by hand. You also had to memorize a bunch of algorithms (rather than understanding how they worked or how to modify them to solve different problems). The professor also had a "can't do anything about it" attitude, and so the entire class was blatantly cheating as a result, and I got the worst grade of my academic career. It sort of broke the camel's back for me; I consider our current approach to academics to be fundamentally broken. It's harder to design exams where people cannot cheat, but it's certainly possible. Randomize the orders of questions on the test. Have multiple versions the same question (e.g. in a math exam, change a 2 to a 4, or a sin to a cos). Now you have unique exams for each student. Most importantly, design questions that require critical thinking, and allow everyone to use their computers/books/notes/whatever. That's far more representative of real life anyway. These simple changes would both make cheating very difficult, and result in better learning: memorizing a bunch of crap the day before an exam will have basically no impact in my life. Learning how to reason critically about the subject matter will give me lasting benefits, even if that subject never comes up again. This ProctorU stuff is just quadrupling down on a fundamentally broken approach and making it much worse.
- jdmichal 5y ago
  My AP calculus teacher allowed us to use calculators on our tests. Why? Because he knew exactly how to design questions such that the calculator would switch from exact to approximation mode. So you could enter any problem on the test into the calculator, and all it would spit out is a useless answer with as many decimal places as it could handle. Of course the calculator worked fine on every homework question. But you better have still learned the material if you wanted to make it through the test.
  - sonograph 5y ago
    I don't follow. Do you mean to say that the calculator would produce .333333333 repeating but the student was expected to write 1/3 ?
ModernMech 5y ago
> I had a few professors who made exams ridiculously hard with strict time limits, just because they expected people to cheat. So the exams were designed in a way they cheating was the only way to get through it, which just encouraged more people to cheat. That’s such a strange response to that expectation. For the class I teach, I made my exams open book, open notes, open internet and gave them a extended time to work on the exam. If they’re gonna cheat, they’re gonna cheat. Don’t fight the tide. But the questions I asked where analysis/synthesis questions that couldn’t simply be looked up, and student performance was on a bell curve with a 80 average (in line with previous years). I think a lot of professors need to embrace the situation and adapt rather than forcing a police state on students during exam times.
- TravisHusky 5y ago
  I had a couple professors do exactly what you did and it was much more enjoyable. I feel like I leaned a lot more in classes like that, and now that I have a real engineering job I have realized this style is a lot more accurate to what the real world is like.
deregulateMed 5y ago
In engineering school, our professors wanted to treat things like the real world (as much as you could during test time). Their solution was to let us use whatever we wanted except other students. Cellphones, textbooks, laptop, Internet. You had 2 hours to answer 2 or 3 questions, it was definitely reasonable if you studied... But the questions were insane. You know how homework would be assigned 1-50 odds? These were like the problems 74 and 76, 1/4 page long and difficult, multiple parts. That seems as similar as engineering school got to the real would outside our sophomore and senior design projects.
zelphirkalt 5y ago
> Honestly I don't think I can fault students who cheated during the pandemic, it was just so abnormal that most people did whatever they had to to cope. Cheating is never OK. Look what that lead to. A few bad apples ruined it for the other students. People have to learn, that their behavior in such a setting does not only affect themselves. In this case it very negatively impacted everyone studying with them.
- gopher_space 5y ago
  Why are we constantly surprised when people focus on the only metrics they're judged by?
- johnnyanmac 5y ago
  >People have to learn, that their behavior in such a setting does not only affect themselves at some point it's like defensive driving. Sure, they are at fault and an idiot, but for the sake of your own safety you shouldn't "stick to your morals" or just "hope they get theirs". Look out for yourself, because for some people that's the only person that will do it. With that lens, yes. I don't blame people who need to do what they do for one day in some artificial environment so they aren't impacted in their transition to real world work where they are otherwise moral.
- 908B64B197 5y ago
  > People have to learn, that their behavior in such a setting does not only affect themselves. In this case it very negatively impacted everyone studying with them. Except, for many competitive positions, that's a zero-sum game.
  - zelphirkalt 5y ago
    Unfortunately you are right and it probably means, that for many competitive positions the process of evaluation is not a good one.
- majjgepolja 5y ago
  It's a grey area. In india, the engineering curriculum includes lot of subjects that are not useful for the students but only there because some fat belly officer thought it would be "Interdisciplinary". Can you imagine teaching biology as a subject for engineers? waste of money and not what we have come to learn, or interested in. But colleges in India do that. Cheating in such subjects is fair.
hinkley 5y ago
We had a particularly articulate young man in our graduating class that argued that checking the book is ultimately not cheating in the world of professional CS and software development. Rather, it’s considered being responsible. So why should we be taking tests that treat it as anomalous or cheating? He convinced one professor, possibly two, but if he had any more luck than that, I wasn’t in those classes with him. Most of what we do is synthesizing facts into knowledge. But I know from copious personal experience that there is a wide grey area between recalling a fact at will and forgetting it exists entirely. I am fairly good at recalling concepts in general terms. Y might be applicable in this case, but I need to check the details to be sure/explain how. Which is also why I think banning computers from planning meetings is stupid. You want us to agree to do things without being able to spot check any of our hunches that will drastically effect our estimates? That’s a winning plan /s.
- camgunz 5y ago
  Totally agree. Generally my response to that situation is usually, "wait you did that from memory without looking it up? That's super irresponsible, check your work or use an existing ___".
- ekidd 5y ago
  > We had a particularly articulate young man in our graduating class that argued that checking the book is ultimately not cheating in the world of professional CS and software development. My school's CS department defaulted to allowing students to use almost any available resource (unless specifically indicated otherwise). But you were required to write down what resources you used. So a professor might assign a whole pile of nasty algorithm proofs, and say, "You're allowed to work in groups to find the general solution. But you need to write down your group members, and you need to do your own writeups." Tests were in person but not especially proctored. The penalty for cheating was a heavy suspension and a transcript annotation, with permanent expulsion for a second offense. This actually worked pretty well, back in the day.
fddddd 5y ago
i still cannot understand why american (i am assuming) education is based on competition and ranking students. almost like the point is NOT education at all. your comment makes no sense in my universe. Thankfully.
an_opabinia 5y ago
> it was so frustrating not only the amount of cheating that occurred Yeah, it's crazy that cheaters are the protagonist of the ban e-proctoring story. What if the university only admitted students who don't cheat? How do we know that policy works for real at a place like Caltech? Academic culture is accommodating, and you feel that way too. But universities must know that cheating harms everyone, it's a losing proposition. The right response should have been to suspend grading.
- cvwright 5y ago
  Or just grade other work that doesn't require proctoring. Personally, I removed exams entirely in the last courses I taught in Spring 2020, and it seemed to work out OK. I had no faith that the proctoring systems would catch everything, and I had no desire to inflict them on my students in any case.
- zepto 5y ago
  > What if the university only admitted students who don't cheat? It’s a common fallacy to attribute behavior to innate qualities of people, rather than situations.
  - bulatb 5y ago
    For anyone interested, it's called the fundamental attribution error.
  - tbrownaw 5y ago
    And yet there truly are people who are far more (or far less) honest than other people in the same situations.
ridiculous_leke 5y ago
> Honestly I don't think I can fault students who cheated during the pandemic, it was just so abnormal that most people did whatever they had to to cope. I beg to differ. Saying that dishonesty is acceptable in certain scenarios will only motivate them to further partake in bad acts. In extreme cases, the child will end up as a criminal.
- johnnyanmac 5y ago
  "In extreme cases, the child will end up as a criminal." these are university students pressured to have high grades for internships/first jobs, not some impressionable elementary schooler. Thinking way too obtusely for this to be a factor and compare this to some middle schooler getting into drugs.
Spooky23 5y ago
I graduated in 2000, and cheating was rampant if you knew where to look. One variety was legal - you’d have a doctors note to get a reasonable accommodation for ADD. In the 90s, it was pretty trivial to do that. Once you had that, you were taking tests in a facility that made cheating very easy (open book) if you were motivated.
908B64B197 5y ago
Places that take academic honesty seriously tend to find ways to not have cheating happen in the first place. Caltech is notorious for it's take-home exams for instance. But let's look at the reality of a student at a normal institution or trying to get into college today; it's a series of high stakes exams that decides your future. And a prisoners' dilemma since as soon as someone cheats you have to do it as well just to keep up. This used to be high risk high reward but now, thanks to the pandemic, it suddenly became low risk high reward. No wonders everyone is doing it. Really, it's a great equalizer. Pre-Pandemic, it was a common strategy to get "diagnosed" with ADHD to get extra time during exams. But for that you needed well connected parents. Now everyone can cheat.

tppiotrowski 5y ago

Does anyone in academia know if tests are designed on a curve? You can give a test that everyone gets 100% on (assuming they show up) and you can give a test that everyone fails. Is part of creating a test thinking about how many students in your class are capable of scoring A’s, etc or is it just a side effect

mikepurvis 5y ago
I had a highschool calculus teacher who was very explicit about designing their tests on an A/B/C system. The idea was that the A section was the basic plug-n-chug versions of the problem that everyone should be able to get if you were even half paying attention in class; the B section is stuff that requires a bit more reasoning and analysis, and may have a pitfall or two, but they'll be things that were at least mentioned; and the C section is effectively extra credit— a problem where you needed to have a deeper understanding in order to figure out something novel about it, or like you needed to re-derive something from first principles in a way that was slightly different from what was shown in class, that kind of thing. And the sections weren't equally weighted; I think it was usually like 50/30/20, or even 60/30/10. Some people hated this, but I really liked how explicit it was. There was no mystery meat— the whole evaluation scheme was very open about its design and intent.
denimnerd42 5y ago
From my experience... it varies widely. The university will have a standard, the department will, the professor will. I had experience taking undergraduate courses at 4 institutions in the USA and of course many departments. I had some professors that expected the grades to fall like grade school did with 90-100 % being a high percentage. Others gave 4-6 difficult multi part problems and graded on a transparent curve. Others gave difficult problems and were not transparent about the grading scheme.
corty 5y ago
Depends on country, university and professor. In Germany, the general rule is that grading on a curve isn't allowed or at least strongly discouraged. There was a short while when such a system was acceptable, called ECTS grades (not to be confused with ECTS credits), but that was done away with in a year or so. Currently, grades are based on the lecture contents and the expectation of the lecturer for the progress a student should make. Lecturers are relatively free to do whatever they please within those bounds. If a test ends in everybody failing, tough luck, maybe next time. If that unfortunate event does repeat too often, the dean might get involved, but can't do a lot more than talk to the lecturer.
nextlevelwizard 5y ago
If school is using grading curves that school has already failed and there is no saving it before grading system changes.
allgreed 5y ago
Not strictly curve grading, but when I was studying electronics one of the professors had a 9-step algorithm for processing raw scores into grades. That involved normalizing the lab scores between different reviewers (so that harshness of a particular reviewer would be compensated for). He also assigned `cos(percentage_from_other_test as radians)` instead of resits if you missed one of the tests for valid reason but had shown up on the other. On one hand I really like the former approach and could understand the latter (organizing resits is likely a huge PITA). On the other that's the only professor I heard of that was attacked with an axe by one of his students.
- cutemonster 5y ago
  > only professor I heard of that was attacked How did that end, if it's not too weird to ask > normalizing the lab scores between different reviewers Sounds like a good idea to me :-)

cowpig 5y ago

I had an experience like this in Numerical Methods in university years ago. The exams were incredibly difficult for bad reasons: you had to calculate many iterations of an algorithm by hand. You also had to memorize a bunch of algorithms (rather than understanding how they worked or how to modify them to solve different problems). The professor also had a "can't do anything about it" attitude, and so the entire class was blatantly cheating as a result, and I got the worst grade of my academic career. It sort of broke the camel's back for me; I consider our current approach to academics to be fundamentally broken. It's harder to design exams where people cannot cheat, but it's certainly possible. Randomize the orders of questions on the test. Have multiple versions the same question (e.g. in a math exam, change a 2 to a 4, or a sin to a cos). Now you have unique exams for each student. Most importantly, design questions that require critical thinking, and allow everyone to use their computers/books/notes/whatever. That's far more representative of real life anyway. These simple changes would both make cheating very difficult, and result in better learning: memorizing a bunch of crap the day before an exam will have basically no impact in my life. Learning how to reason critically about the subject matter will give me lasting benefits, even if that subject never comes up again. This ProctorU stuff is just quadrupling down on a fundamentally broken approach and making it much worse.

jdmichal 5y ago
My AP calculus teacher allowed us to use calculators on our tests. Why? Because he knew exactly how to design questions such that the calculator would switch from exact to approximation mode. So you could enter any problem on the test into the calculator, and all it would spit out is a useless answer with as many decimal places as it could handle. Of course the calculator worked fine on every homework question. But you better have still learned the material if you wanted to make it through the test.
- sonograph 5y ago
  I don't follow. Do you mean to say that the calculator would produce .333333333 repeating but the student was expected to write 1/3 ?

ModernMech 5y ago

> I had a few professors who made exams ridiculously hard with strict time limits, just because they expected people to cheat. So the exams were designed in a way they cheating was the only way to get through it, which just encouraged more people to cheat. That’s such a strange response to that expectation. For the class I teach, I made my exams open book, open notes, open internet and gave them a extended time to work on the exam. If they’re gonna cheat, they’re gonna cheat. Don’t fight the tide. But the questions I asked where analysis/synthesis questions that couldn’t simply be looked up, and student performance was on a bell curve with a 80 average (in line with previous years). I think a lot of professors need to embrace the situation and adapt rather than forcing a police state on students during exam times.

TravisHusky 5y ago
I had a couple professors do exactly what you did and it was much more enjoyable. I feel like I leaned a lot more in classes like that, and now that I have a real engineering job I have realized this style is a lot more accurate to what the real world is like.

deregulateMed 5y ago

In engineering school, our professors wanted to treat things like the real world (as much as you could during test time). Their solution was to let us use whatever we wanted except other students. Cellphones, textbooks, laptop, Internet. You had 2 hours to answer 2 or 3 questions, it was definitely reasonable if you studied... But the questions were insane. You know how homework would be assigned 1-50 odds? These were like the problems 74 and 76, 1/4 page long and difficult, multiple parts. That seems as similar as engineering school got to the real would outside our sophomore and senior design projects.

zelphirkalt 5y ago

> Honestly I don't think I can fault students who cheated during the pandemic, it was just so abnormal that most people did whatever they had to to cope. Cheating is never OK. Look what that lead to. A few bad apples ruined it for the other students. People have to learn, that their behavior in such a setting does not only affect themselves. In this case it very negatively impacted everyone studying with them.

gopher_space 5y ago
Why are we constantly surprised when people focus on the only metrics they're judged by?
johnnyanmac 5y ago
>People have to learn, that their behavior in such a setting does not only affect themselves at some point it's like defensive driving. Sure, they are at fault and an idiot, but for the sake of your own safety you shouldn't "stick to your morals" or just "hope they get theirs". Look out for yourself, because for some people that's the only person that will do it. With that lens, yes. I don't blame people who need to do what they do for one day in some artificial environment so they aren't impacted in their transition to real world work where they are otherwise moral.
908B64B197 5y ago
> People have to learn, that their behavior in such a setting does not only affect themselves. In this case it very negatively impacted everyone studying with them. Except, for many competitive positions, that's a zero-sum game.
- zelphirkalt 5y ago
  Unfortunately you are right and it probably means, that for many competitive positions the process of evaluation is not a good one.
majjgepolja 5y ago
It's a grey area. In india, the engineering curriculum includes lot of subjects that are not useful for the students but only there because some fat belly officer thought it would be "Interdisciplinary". Can you imagine teaching biology as a subject for engineers? waste of money and not what we have come to learn, or interested in. But colleges in India do that. Cheating in such subjects is fair.

hinkley 5y ago

We had a particularly articulate young man in our graduating class that argued that checking the book is ultimately not cheating in the world of professional CS and software development. Rather, it’s considered being responsible. So why should we be taking tests that treat it as anomalous or cheating? He convinced one professor, possibly two, but if he had any more luck than that, I wasn’t in those classes with him. Most of what we do is synthesizing facts into knowledge. But I know from copious personal experience that there is a wide grey area between recalling a fact at will and forgetting it exists entirely. I am fairly good at recalling concepts in general terms. Y might be applicable in this case, but I need to check the details to be sure/explain how. Which is also why I think banning computers from planning meetings is stupid. You want us to agree to do things without being able to spot check any of our hunches that will drastically effect our estimates? That’s a winning plan /s.

camgunz 5y ago
Totally agree. Generally my response to that situation is usually, "wait you did that from memory without looking it up? That's super irresponsible, check your work or use an existing ___".
ekidd 5y ago
> We had a particularly articulate young man in our graduating class that argued that checking the book is ultimately not cheating in the world of professional CS and software development. My school's CS department defaulted to allowing students to use almost any available resource (unless specifically indicated otherwise). But you were required to write down what resources you used. So a professor might assign a whole pile of nasty algorithm proofs, and say, "You're allowed to work in groups to find the general solution. But you need to write down your group members, and you need to do your own writeups." Tests were in person but not especially proctored. The penalty for cheating was a heavy suspension and a transcript annotation, with permanent expulsion for a second offense. This actually worked pretty well, back in the day.

fddddd 5y ago

i still cannot understand why american (i am assuming) education is based on competition and ranking students. almost like the point is NOT education at all. your comment makes no sense in my universe. Thankfully.

an_opabinia 5y ago

> it was so frustrating not only the amount of cheating that occurred Yeah, it's crazy that cheaters are the protagonist of the ban e-proctoring story. What if the university only admitted students who don't cheat? How do we know that policy works for real at a place like Caltech? Academic culture is accommodating, and you feel that way too. But universities must know that cheating harms everyone, it's a losing proposition. The right response should have been to suspend grading.

cvwright 5y ago
Or just grade other work that doesn't require proctoring. Personally, I removed exams entirely in the last courses I taught in Spring 2020, and it seemed to work out OK. I had no faith that the proctoring systems would catch everything, and I had no desire to inflict them on my students in any case.
zepto 5y ago
> What if the university only admitted students who don't cheat? It’s a common fallacy to attribute behavior to innate qualities of people, rather than situations.
- bulatb 5y ago
  For anyone interested, it's called the fundamental attribution error.
- tbrownaw 5y ago
  And yet there truly are people who are far more (or far less) honest than other people in the same situations.

ridiculous_leke 5y ago

> Honestly I don't think I can fault students who cheated during the pandemic, it was just so abnormal that most people did whatever they had to to cope. I beg to differ. Saying that dishonesty is acceptable in certain scenarios will only motivate them to further partake in bad acts. In extreme cases, the child will end up as a criminal.

johnnyanmac 5y ago
"In extreme cases, the child will end up as a criminal." these are university students pressured to have high grades for internships/first jobs, not some impressionable elementary schooler. Thinking way too obtusely for this to be a factor and compare this to some middle schooler getting into drugs.

Spooky23 5y ago

I graduated in 2000, and cheating was rampant if you knew where to look. One variety was legal - you’d have a doctors note to get a reasonable accommodation for ADD. In the 90s, it was pretty trivial to do that. Once you had that, you were taking tests in a facility that made cheating very easy (open book) if you were motivated.

908B64B197 5y ago

Places that take academic honesty seriously tend to find ways to not have cheating happen in the first place. Caltech is notorious for it's take-home exams for instance. But let's look at the reality of a student at a normal institution or trying to get into college today; it's a series of high stakes exams that decides your future. And a prisoners' dilemma since as soon as someone cheats you have to do it as well just to keep up. This used to be high risk high reward but now, thanks to the pandemic, it suddenly became low risk high reward. No wonders everyone is doing it. Really, it's a great equalizer. Pre-Pandemic, it was a common strategy to get "diagnosed" with ADHD to get extra time during exams. But for that you needed well connected parents. Now everyone can cheat.