9 ms·
Here's the take-away quotation for me: The better the professors were, as measured by their students' grades in later classes, the lower their rati
by ColinWright 12y ago
Here's the take-away quotation for me:
The better the professors were, as measured by their
students' grades in later classes, the lower their
ratings from students.
"If you make your students do well in their academic
career, you get worse evaluations from your students,"
Pellizzari said. Students, by and large, don't enjoy
learning from a taskmaster, even if it does them some
good.
- Siecje 12y agoI don't think that applies at the college/university level. Evaluations are at the end of the course and you will know if you have learned a lot. The problem is profs just reading the textbook or parts of the textbook in a powerpoint, without challenging students.
- bvrlt 12y agoEven at the college/university level I have seen students complaining about professors that were fairly good, sometimes just because the grading was a bit tough.
- Siecje 12y agoWould that be a majority though?
- tr352 12y agoWell those might be legitimate complaints. Professor is fine but his grading is too tough.
- emodendroket 12y ago"Too tough" means "I didn't get the grade I wanted." Grade inflation is a real problem.
- rpcope1 12y agoAgreed. When I was teaching before I started out as a developer, it was unheard of to fail anyone in an entry level Physics class (granted this was an Ivy League school); over many semesters I recall thinking that we had passed several students that had no business advancing "because medschool needs high GPAs" or because we didn't want to ruin some kid's future in engineering (when they may not have been successful anyways). But yeah many (most?) of the kids care about a high grade before learning anything, and expect nothing less than an A, even if they don't deserve it.
- pliny 12y agoemodendroket: 'Too tough', as I've heard it, almost always means 'failing average' or 'failing median', but we can only trade anecdotes around that.
- emodendroket 12y agoBut grade inflation is a real and documented phenomenon that would seem to be related.
- sklogic 12y agoBy the end of the course they'd only know they've got an exam to pass and they'll hate it. Students should not have any say in anything related to their courses, professors, marking, workload and such.
- Siecje 12y agoNo say at all? Not even trigger a review? Profs that consistently get poor reviews are getting them for a reason.
- ColinWright 12y agoPossibly that reason is that the students are being made to work hard to get their grades, and not simply being given good grades for no work.
- sklogic 12y agoBack in my days in the university we (all the students) hated mostly the toughest professors. Now, many years later, the only stuff that I still remember well, to a degree that I can go and pass an exam, despite not using much of it in my work, is from the courses of those most hated professors. And now students are much worse, they're expecting a "value for money", they want to be entertained. They do not like being pushed hard. Just look at all those disgusting stories: http://sheffield.tab.co.uk/2015/01/29/devastated-economists-start-petition-outrageous-exam/ http://sheffield.tab.co.uk/2015/01/29/devastated-economists-... (what kind of cretins can find such an exam "too complicated"?) http://www.bbc.co.uk/news/education-31814659 http://www.bbc.co.uk/news/education-31814659 (another bunch of morons enjoying a right to have their say) This crap must be stopped. Once and for all.
- jimmaswell 12y agoAre you saying all those students just weren't paying attention in class or something? It seems suspect if that many of them spoke out about it
- 12y ago
- dagw 12y agoBased on my experience at University great teachers who push and challenge students are generally disliked by the large group of students that don't particularly want to be pushed or challenged.
- ohfunkyeah 12y agoBut why wouldn't they want to be pushed and challenged? The only thing universities offer is the chance to learn more and be pushed or challenged. AFAIK they could not possibly be there for any other reason than to learn deeply. I think it would be interesting to know if professors who push and challenge within a non-dgree open online course would face the similar wrath? I'd bet not.
- chrisbennet 12y ago"The only thing universities offer is the chance to learn more and be pushed or challenged." Um, have you been to a university? ;-) When you think about it, the professors aren't (necessarily) there to teach either. They are there primarily for the opportunity to do research though that may be changing as many professors are part time minimum wage contractors.
- ohfunkyeah 12y agoYeah, exactly my point. That statement is laughable to anyone who as been to a University. I'm not even sure if being pushed and/or challenged to become better educated is even a primary focus of Universities.
- dubya 12y agoThe quote is about a pair of university courses. Students, and probably just people in general, are really bad at knowing what they have learned.
- ColinWright 12y agoI see a common theme in this and your other comment[0]. In my experience, however, evaluations from students have next-to-nothing to do with how much the students have or have not learned, and that is the point of the linked study[1]. Quoting: > Controlled, randomized experiments find that > SET ratings are negatively associated with > direct measures of effectiveness. SET seem > to be influenced by the gender, ethnicity, > and attractiveness of the instructor. The other link[2] says: > We find that teacher quality matters substantially > and that our measure of effectiveness is negatively > correlated with the students’ evaluations of professors. Both these formal studies are at odds with what you seem to be saying. ======== [0] https://news.ycombinator.com/item?id=9445924 https://news.ycombinator.com/item?id=9445924 [1] http://www.stat.berkeley.edu/~stark/Preprints/evaluations14.pdf http://www.stat.berkeley.edu/~stark/Preprints/evaluations14.... [2] http://www.sciencedirect.com/science/article/pii/S0272775714000417 http://www.sciencedirect.com/science/article/pii/S0272775714...
- tjl 12y agoI've only known a few profs who just read the text or parts of the text in powerpoint. Of the profs I was a TA for, only one used powerpoint and he made his own slides separate from the text. It definitely applies. One of the best profs in my department often got poor evaluations in some of the first year courses she taught (which were required for everyone). But, she consistently gets excellent ratings for her 3rd year, 4th year, and grad courses (which were targeted for her specialty). She's known for being tough, but students can learn a lot in her courses and they actually do well. First years seem to think that they can get away with more because she's a short woman. She's had students try and suggest how to change her exams after midterms because they've taught swimming lessons. She once had a comment on RateMyProfessor.ca, "I'd say she worships Satan, but I think Satan worships her." It was eventually dropped after several years, but she wrote it in calligraphy and put it up in her office. We all thought that was very funny.
- Sir_Substance 12y agoThe methodology is flawed. If a lecturer really is terrible, then more people will fail that course and not go on to do the advanced course, artificially raising the average for the advanced course because only the best students are able to pass the prerequisite DESPITE the terrible lecturer.
- strathmeyer 12y agoYeah, or even... good students are better at identifying bad professors. Some of my professors were leaders in their field but couldn't teach a class worth anything. I can see why the smart students would get good grades in those classes. Why wouldn't the rest of us be able to tell that they were a bad professor??
- cantankerous 12y agoTrue in theory, but not true in practice. Terrible lecturers find ways to rationalize the poor grades of their students (i.e. externalize the blame) and curve grades to get kids to pass the class. Especially bad lecturers will give the bulk of students high grades to preclude complaints. For their part, poor students could care less about what they learn, instead focusing on passing or getting a good letter grade. In poor programs, subsequent more advanced courses in a sequence are subjected to downward pressure when it comes to teaching more rigorous or advanced topics because the students suck so badly (because of the lack of rigor in early courses). A cluster of poor students can be surprisingly good at stymieing course progress. Many professors have to perform research and would rather placate the students with good grades instead of wasting their research time, which is vital to maintaining their careers (Teaching is secondary at research universities no matter what administration tells you) . The can gets kicked down the road, and mediocrity matriculates.
- yodsanklai 12y agoI'm not sure it is that simple. I believe most university students can tell the difference between a good and a bad professor and are honest enough to fill up evaluation forms in good faith. They are able to assess the involvement of their professors, the quality of the projects and the course material. On the other hand, they aren't qualified to discuss the relevance of the topic for instance. I think this type of evaluation has a role to play in order to improve teaching, but shouldn't be given too much importance for evaluating professors.
- sklogic 12y agoMost university students are too young to be able to tell the difference. And they're spoiled by all that "consumer rights" crap. Education is a peculiar thing, the more it hurts, the better the results. But people do not like when it hurts, especially the young and unexperienced ones.
- _delirium 12y agoI would be more willing to believe that with some time passing. In my own case, how I judged my professors with 3-5 years of hindsight is different from how I judged them right at the end of the course, when I filled out the evaluations. The biggest factor in my own case is that in retrospect I have more respect for the difficult courses, and less respect for the easy courses, then I did at the time they actually took place. I think this is mostly because at the time I judged courses by whether they felt fair/unfair, and the easiest way for a professor to avoid students feeling they were judged unfairly is to just judge everyone in a broadly positive way. If you give some people Cs, inevitably some of them will feel they deserved higher (and sometimes they will even be right, since there is an error rate). While if you give everyone an A/B there's less cause for complaint, because many fewer students perceive getting a grade higher than they deserve as unfair. A secondary factor is that when judging in retrospect I put a little less weight on personality and style than I did at the time. Professors with a "entertaining/engaging" style generally seemed good to me at the time, but in retrospect some of them were a bit shallow in the actual material (some were good, though). As an adult occasionally looking for online lectures, I now tend to specifically avoid the more "TED-style" lecturers, even though they are initially appealing, and find I get more out of a more straightforward, sober style. Some of the really easy and "fun" courses in particular feel like a missed opportunity to me: we had a good time every week in class, I got an A, and I rated the course positively, but I've had to go back and self-study from a book because I had not actually learned much the first time around. If you asked me for the rating 5 years later, I would've revised it downwards!
- FollowSteph3 12y agoThat's the crux, the worst and best teachers will be evaluated almost the same. You need some kind of additional flag to identify this, and unfortunately the next class isn't always possible. Another idea would be a follow up survey 5+ years after the student fraudsters. This is possible as most professors teach for longer than 5+ years.
- atirip 12y agoThis. When i look back at my school times - all those who i, let's say, hated back then are those who i now remember most fondly and who actually teached me something.
- danieltillett 12y agoThis is exactly my experience from when I was a professor. I drove my students to the maximum level I could and still keep my evaluation score just above the minimum (3.5/5). At the time they hated it, but later on they loved to tell me how much they learnt in my classes - their memory of all the work faded and they were left with the true feeling of accomplishment.
- regehr 12y agoHere's a different study with similar findings: http://www.econ.ucdavis.edu/faculty/scarrell/profqual2.pdf http://www.econ.ucdavis.edu/faculty/scarrell/profqual2.pdf "... our results show that student evaluations reward professors who increase achievement in the contemporaneous course being taught, not those who increase deep learning."
- ohfunkyeah 12y agoIt's easy to take this and the quote above and leap to the assessment that students like professors that give good grades. But why is this? I think it comes from a fundamental disconnect between what a lot of students really want and what universities are complicit in pretending to offer. A lot of students want the degree so they can get a job in field XYZ. Universities are more than happy to take that desire to get a job and conflate it with a desire to get a higher-level education. They are the gate-keepers to getting a job in many different fields but in many ways act as if they have almost zero responsibility for that responsibility. Just imagine if universities decided to no longer offer degrees and only offered the opportunity for deep understanding and learning. Get rid of grades too, just offer P/F for readiness for the next level of teaching. Do you think student evaluations would still have this bias?
- nilkn 12y agoI don't doubt that this is true in general and is sufficient to destroy any attempt to have students control professor selection, but I'm hesitant to take too much away from this. The best professor in my school's math department was also the most beloved; he was routinely showered with praise by students, and his students were also very successful in later classes. And his classes were not at all easy. I guess we can rank teachers in three tiers: (1) The lowest tier, consisting of teachers both loved and despised who either way fail to prepare students for future classes. (2) Abhorred teachers who do succeed in preparing students for future coursework. (3) The highest tier, consisting of beloved teachers who do succeed in preparing students for future coursework. It's very hard to get into the third tier, because it requires remarkable finesse to make students feel good about having to work extremely hard and possibly still not getting a good grade.
- Tloewald 12y agoI suspect (3) is pretty much impossible, and being — say — 2.5 involves being a gifted entertainer and either having tenure or dumbing down your grading to avoid ticking off students just for giving out fair grades.
- nilkn 12y agoI think (3) is possible, though exceedingly rare, and perhaps Feynman would be an example.
- fragmede 12y ago> The best professor in my school's math department was also the most beloved Out of curiosity, what class traditionally 'belonged' to that teacher? Freshman classes for non-majors (think pre-algebra for art majors) taught in a harsh-but-fair manner is going to score differently than an upper-class or graduate level on manifolds.
- Crito 12y agoIn my case, there were two professors that were widely loved and often cited as the best professors. One was an english professor who had control over the courses about science fiction and fantasy, and often taught a Tolkien course. No real mystery why he was so popular (although he was also a really great personable guy). The other was a math professor that taught the standard assortment of undergrad math classes. I had him for Calc I, Calc III, and Discrete. Most of the math professors in my university that were teaching those classes (particularly the calculus classes) were either hated or unknown. However he had a reputation for being a truly gifted lecturer, and for having incredibly accommodating office hours. His reputation was well earned and deserved.
- evanpw 12y agoA lot of students are there to get a degree, not to learn something. Employers don't know or care how much freshman chemistry you remember (unless you're a chemist), but they do care if you didn't finish your degree because you couldn't pass some requirement. I wonder if the the same relationship is true in fields where there is a licensing exam at the end of your degree (like engineering). Or maybe something like a high-school AP class, where the final exam isn't written by the person teaching. In that case, the teacher would be more obviously on "the same side" as the student.
- ohfunkyeah 12y agoI'd argue that most employers don't really care. They want to use degree, university, and sometimes grades as a first-round filter for screening applicants. Do they actually care if you took the challenging Philosophy course from the good professor, or the easy-A from the Roman History professor? Hell no. So if the primary thing you want is a job, why would you ever take the challenging class? If a professor is significantly and knowingly more challenging than their peers and they don't adequately convey that up front why shouldn't they deserve a bad review. Part of the job is conveying expectations, and in my experience it seems like plenty of professors who will challenge and push know they are like this beforehand but really don't do anything they convey this until after a student is committed.
- nostrebored 12y agoI think that you're right that employers don't care about the specific courses that you took. I think you're wrong to assume that that doesn't mean that those who do take the more challenging courses do get ahead. The best networking I've done was in my challenging courses, where I met smart people who were also interested in learning and bettering themselves. My admittedly skewed and anecdotal evidence is that those people I knew who challenged themselves are now working at better jobs or going to better grad schools than those who decided to coast by. I did not have a single situation where I did not know the difficulty of a course going in. While professors may not adequately let you know, any one of your friends or a number of websites make this information easy to obtain. I feel like I might be alone in this, but I feel like if anything, a professor should warn you if they know that they do not challenge and push. You're in a university course -- it should be challenging. Courses should not be designed for an average student to excel.
- kazinator 12y agoOf course, a lot of the low ratings would also have come from some students who didn't have any grades at all from those later courses, because they didn't make it. Nothing provokes a low rating like failing.
- cgearhart 12y ago>> Society should not punish people who kill people like Locascio. Direct quote from a student eval [1] of the hardest professor I've ever had. There are more like it. The professor blew it up and posted it on his bulletin board. It would irreparably damage higher learning to put the livelihood of teachers like this in the hands of kids who can't even legally drink yet. And -- in keeping with the premise of the article -- I went on to spend the next two years on the Dean's List, in no small part because I had learned so much in Locascio's classes. [1] http://polyratings.com/eval.phtml?profid=382 http://polyratings.com/eval.phtml?profid=382
- penprogg 12y agoThe problem with this is that society does not accept failure. Fail a few times in college and your GPA is irreparably damaged, you have to spend extra time (and money, oh god the money) retaking courses you "should" have passed on the first go. I find myself gaining the most from courses where the professor destroys me. I spend all semester struggling with certain concepts and then at some point towards the end, once I've been exposed to the bigger picture, everything falls together and all the previous material I didn't understand now makes sense. The problem is that I've already been evaluated for the material. If I get a D in a course and retake it and get an A should I still have that D on that record, even though I arguably know the material better than someone who got a B on their first go? While failure is probably the best way to learn, society conditions people to avoid failure like the plague.