9 ms·
The typo at the root of Harvard's cheating scandal
- tribeofone 14y ago> series of discoveries that led him to bring the final take-home exams submitted by his students What? They have final TAKE HOME exams at Harvard?
- courtewing 14y agoI always found take-home exams to be the hardest exams I ever took, and I think they most accurately test a person's depth of knowledge about a subject. The problem with in-class exams is that they often reward test-taking and memorization skills rather than organization and analysis.
- adestefan 14y agoI had a lot of take home mid-terms and in class final exams with the same "figure out 2 or 3 proofs" format. The professors were always more forgiving on the final exam since you only had 3 hours. But if you missed one step in the take home mid-term that you had 4 or 5 days to complete, BAM mark that baby way down.
- streptomycin 14y agoAnd the problem with take-home exams is that everyone cheats on them. It's common knowledge to students. Usually nobody gets caught, though.
- tzs 14y agoDo people find that surprising? I don't, but I went to Caltech so am used to the idea of take home exams. At Caltech, essentially all exams, including finals, are take home. If a professor wants to give an in-class exam, he has to get special permission to do so. I think MIT now also has take home exams, but I'm not sure. Any MIT people here who can clarify?
- michaelt 14y agoDo people find that surprising? Somewhat; because of its nature, cheating is very hard to quantify - I know there was some at my school but I can only speculate as to how much went on behind closed doors. Was collaboration permitted/encouraged on all assessment? In a lot of the group work at my school there tended to be some people who contributed nothing but complaints about their hangover - but who got good grades on the back of the group. I would have thought more group work would exacerbate this problem; do you think that was the case?
- Anechoic 14y agoI think MIT now also has take home exams, but I'm not sure. Any MIT people here who can clarify? I had at I think one take-home exam at MIT during my time there (1991-1995) and we were explicitly allowed (and encouraged) to collaborate, so long as we gave credit to the person we collaborated with. During one of the other HN Harvard-cheating-scandal threads, another poster mentioned that a take-home exam s/he had at MIT specifically forbid collaboration.
- pdonis 14y agoI never took any take-home exams when I was at MIT (1983-1988). Most of the in-class exams I took there, though, were open-book, open-notes, etc., so making them take-home would not have been too much of a change. (Someone upthread commented that a good take-home exam is much more difficult because the professor can assume you have access to all reference materials. That fits my experience with the open-book, open-notes MIT exams.)
- tzs 14y agoNo take home tests while you were there fits in with what I infer from this document: http://web.mit.edu/faculty/reports/exam-termregs/report.html http://web.mit.edu/faculty/reports/exam-termregs/report.html It's a report from their Faculty Policy Committee's Subcommittee on Examination Terms and Regulations, undertaking in 1998. Among the things the report covers is consideration of lifting the ban on take home tests. From the documents they reference, it appears that MIT tried in experiment starting in 1992 to allow take home tests, and discontinued the experiment in 1994. In that report, they recommend allowing out-of-room exams, where the exam would be given out at 1:30 PM, the students would have until 7:30 pm to turn it in, and the students can take the test where they want. It looks like the main point of this was to make it so students could have access to computers and libraries during these tests. Their concern with allowing take-home tests seems to be that professors might give monstrous take-home tests that would consume too much time. Upon further Googling, it sounds like this policy or something similar was adopted and is still in place today: http://web.mit.edu/catalog/overv.chap5.html http://web.mit.edu/catalog/overv.chap5.html
- deleted 14y ago[deleted]
- mdesq 14y agoTake home final exams are everywhere and they can easily be some of the most challenging. I like this story of one of Tyler Cowen's final exams[1]: "Tyler [Cowen] once walked into class the day of the final exam and said, “Here is the exam. Write your own questions. Write your own answers. Harder questions and better answers get more points.” Then he walked out. The funniest thing was when a student came in late and I had to explain to him what the exam was and he didn’t believe me!" [1] http://blog.sethroberts.net/2012/08/09/tyler-cowens-unusual-final-exam/ http://blog.sethroberts.net/2012/08/09/tyler-cowens-unusual-...
- Evbn 14y agoThat's essentially a funny way of describing a term paper.
- fnordfnordfnord 14y agoIt lessens the importance of rote memorization.
- ejames 14y agoTake home exams are somewhat common at modern universities, and in fact are sometimes used as an anti-cheating measure. Rather than having questions which can be easily answered with access to research materials, the exam is designed to be difficult even if you have the textbook open on the desk right next to the exam. Take-home exams often specifically grant permission to use the textbook and any other class materials. Because a take-home exam is built on the premise that the student will have access to all of their materials, the professor writes the exam expecting that you have attended all the classes, read all the textbook chapters, and understood all the notes, so the exam is much more difficult! It's also meant to make exams more like real work. Nobody at my company gives a damn if I need to crack open a math textbook to find an algorithm, or Google something - but a real job requires that you can understand and synthesize the information you find. You can't build an entire (...good) product out of copy-and-pasted answers from Stack Overflow but you can look up specific issues or points where you get stuck. Remember that we're seeing this story because the students failed to get away with cheating - in part precisely because of the nature of the exam. One of the questions is an open-ended invitation to pick two events and explain them, and it's very suspicious if a group of students all pick exactly the same two events and present similar-sounding explanations.
- pbhjpbhj 14y ago>the professor writes the exam expecting that you have attended all the classes, read all the textbook chapters, and understood all the notes // As opposed to? Seriously the exams should test your knowledge and application of elements from the whole range of the course material. Giving that as a reason why you can take the exam home and [have someone else] do it sounds entirely absurd to me.
- binxbolling 14y agoIt's much better preparation for the post-college world anyway. The internet enables unparalleled access to information, so knowing a disparate collection of easily searchable facts is not really that useful. Rather, successful people know how to analyze, synthesize, and summarize information, test sources, weigh competing claims, reconstruct arguments, etc. A take home exam is more than able to measure that at least, or better, than an in-class exam.
- masterzora 14y agoTake home exams are common at my alma mater. Hell, I had more than a few limited-time (as in, do it in X hours but it is due in Y days), closed-book, take-home finals.
- K2h 14y agoIf everything is typed, it seems they might be able to run that through http://turnitin.com http://turnitin.com. I think it is meant for mostly essay papers, but I would think with the influence of Harvard they could get a special deal to adapt it to traditional question/answer things and be done with it. Academic dishonesty is a no win situation. It makes the students look bad - and then it makes the school look bad for having low quality students. maybe ethics needs to be a required first quarter class.
- s_henry_paulson 14y agoI'd like to see an automated machine take a look at two papers and conclude that because of a single space in a number that two papers are related.
- Evbn 14y agoAn extremely rare word pair found in multiple documents? That is bog standard latent semantic analysis.
- noahc 14y agoOur computer science professors always claimed to be able to detect cheating because of similar answers, however, I never really believed them. Change the way the program works here or there and rename all the variables, and always use the same variables for your loops (x,y,z or i,k,l for example) between assignments and it'd be hard to detect. Of course, if you went through the effort of doing all that, I always figured it'd be faster just to do it your self. Any ex-TA's or professors want to weigh on this?
- barik 14y ago> Change the way the program works here Then it isn't really the same program if the changes are fundamentally different, so in essence, it isn't direct copying anymore. But changing another person's program in non-superficial ways is often as difficult as just solving the problem from scratch. Cheating is also harder to detect in introductory classes because there are often few good ways to implement the algorithm in the first place (say, factorial, or pre-order traversal of a binary tree). Consequently, these tools tend to work better in larger projects, such as in an operating systems class. > rename all the variables, and always use the same variables for your loops (x,y,z or i,k,l for example) between assignments and it'd be hard to detect. It turns out this is trivial to detect; see MOSS [1] for an example of the type of analysis that is done on programs. However, more often than not, cheating is detected by teaching assistants simply by hand ("Hmm, this submission looks familiar"), but instructors pretend that there is some sophisticated cheat-finding system to scare off students. Usually typos are dead give-aways, especially when two students have the same typo in the same comment at the same identical spot. In my academic misconduct cases, students were most often identified through spelling and grammar errors. I imagine that there exist many more instances of cheating than instructors catch, and that we really only get the low-hanging fruit (and frankly, my job isn't to be the cheating police, so I don't go out of my way to find it). But catching the most obvious cases and having a severe punishment as a deterrence is often enough. ("If you cheat, you likely won't get caught, but if you do, goodbye -- it's automatic failure at minimum, and possibly suspension or expulsion.") [1] http://theory.stanford.edu/~aiken/moss/ http://theory.stanford.edu/~aiken/moss/ and the actual research paper http://theory.stanford.edu/~aiken/publications/papers/sigmod03.pdf http://theory.stanford.edu/~aiken/publications/papers/sigmod...
- nateburke 14y agoThis is not surprising. The culture of varsity sports on campus is a relic of an institution that has optimized its admissions process for corporate job placement over academic integrity and originality of thought. This makes sense--if you can swell your endowment by letting in athletes who are a-ok with taking easy classes and then using their one-track brains to 'flip decks' at Goldman, why not? It's good for them (Goldman pays) and it's good for your own job security as a university administrator. The culture produces student-athletes who are some of the most tenacious, personable, and loyal people you can find. They make great leaders of companies that consist of giant pyramids of people doing menial tasks. This culture, however, does not optimize for original thought. Regarding the exam structure: (humanities + short answer questions + take-home) = increased likelihood of similar answers, given internet search. The professor here was lazy, too--these problems could have been avoided with a comprehensive 20-page paper instead of a more-easily-graded short-answer final exam.
- pstuart 14y agoOr just cut to the chase and use multiple choice.
- Evbn 14y agoHow does an essay cover anywhere near the full breadth of course material.
- cturner 14y agoExam room essays are a great way to measure knowledge, and difficult to cheat on. You have to know the domain thoroughly in order to be ready to write an essay response. Being able to write this demonstrates integrated understanding of the concepts. And probably breadth of knowledge. The easy solution for universities is give people take-home work during the semester and return it marked, but have 100% of the course score determined by a sit-down exam at the end of the period.
- stevesearer 14y agoYou're correct. I taught high school history for several years and used in-class essay responses as the primary testing method. Essays allowed me to understand what students actually know and how their overall knowledge on a topic has developed. Multiple choice-style questions (or any memorization-style question) do test knowledge, but I regularly found that many of the students who could easily memorize facts had a hard time explaining them in a coherent essay describing how the events were interconnected. And students who might get a C on memorization tests often had a better grasp of the period as a whole. Unfortunately, most teachers don't want to take the time to read essay responses because shoving scantron tests through a machine is much easier and less time consuming.
- makmanalp 14y ago> Ellison declined to comment on the letter, saying it is a confidential Ad Board document—indeed, it is branded with a “CONFIDENTIAL” stamp. Wow, I wonder why it is confidential. Isn't it a right to know what you're being accused of? edit: I see, that's fair, as long as the accused get to see.
- Evbn 14y agoIt's not a right of the news media to know.
- rst 14y agoThe board's procedures do give the accused the right "to review all materials considered by the Board in making a decision". The confidentiality rule forbids disclosure of that stuff to those without a "need to know", which would include reporters from the campus paper and the general public. On procedures: http://www.adboard.fas.harvard.edu/icb/icb.do?keyword=k62415&tabgroupid=icb.tabgroup88723 http://www.adboard.fas.harvard.edu/icb/icb.do?keyword=k62415... On confidentiality: http://www.adboard.fas.harvard.edu/icb/icb.do?keyword=k62415&pageid=icb.page430450 http://www.adboard.fas.harvard.edu/icb/icb.do?keyword=k62415...
- fnordfnordfnord 14y agoRight, here's another. http://www2.ed.gov/policy/gen/guid/fpco/ferpa/index.html http://www2.ed.gov/policy/gen/guid/fpco/ferpa/index.html
- Cyranix 14y agoThis isn't a criminal trial. That right doesn't extend to private institutions.
- noahc 14y agoYou're absolutely correct, however, had this been a public university things would have been much different. For example, see: http://thefire.org/cases/dueprocess/ http://thefire.org/cases/dueprocess/
- scott_meade 14y ago"some students said that they will sue the university if any serious punishment is meted out" [1] These are our future business and political leaders ensuring unabated corruption continues for generations to come. It's world-views like these students' which explains why articles like this Onion spoof are sadly funny: http://www.theonion.com/articles/wealthy-teen-nearly-experiences-consequence,2551/ http://www.theonion.com/articles/wealthy-teen-nearly-experie... [1] http://www.nytimes.com/2012/09/01/education/students-of-harvard-cheating-scandal-say-group-work-was-accepted.html?_r=1 http://www.nytimes.com/2012/09/01/education/students-of-harv...
- genwin 14y agoI can kinda see the students' point. If the exam was unreasonable as they claim (they claim it was completely unrelated to the lectures), it may be grounds for cheating rather than go through a lengthy costly path to correcting the exam or ousting the professor, perhaps unsuccessfully. Software developers (or their employers) do this all the time when they ignore frivolous patents.
- pdonis 14y agoUm, you're kidding, right? Of course the students are going to claim the exam wasn't fair; why would you believe them? (On reading the article linked to, the few specific exam questions that were described didn't seem to me to be unrelated to the course.) Also, even if the exam was "unrelated to the lectures", tough luck; they are paying a lot for a degree, on the understanding that the school makes the rules. If the school is being unfair, the correct response is not to cheat; it's to stop placing so much weight on a degree that really doesn't mean much. Finally, your suggested analogy between frivolous patents and a supposedely unfair exam is nonsense. The correct analogy would be between a business that ignores a patent because it is convinced the patent is unfounded and would not stand up to a court challenge, and an employer that ignores a C in Government from Harvard (for a job applicant who took the hit on an unfair exam rather than cheat) because it knows Harvard's grades are no longer an accurate reflection of a person's job potential.
- 14y ago
- patmcguire 14y agoFour or five years ago Columbia threw out the final for the Western Lit class because one professor gave the last year's exam to her section and it spread through the football team. The school found out because they changed a question and it looked suspicious when a quarter of the freshman class gave an answer about Crime and Punishment to a question about the Inferno.