8 ms·
"Are CS grades bimodal, or unimodal? To test this, we ac- quired the final grades distributions for every undergraduate CS class at the University of British Co
by mcguire 10y ago
"Are CS grades bimodal, or unimodal? To test this, we ac-
quired the final grades distributions for every undergraduate
CS class at the University of British Columbia (UBC), from
1996 to 2013. This represents 778 different lecture sections,
containing a total of 30,214 final grades (average class size:
75)."
My understanding of the bimodal situation, if it exists, is that it primarily applies to earlier classes---later classes only include those who did well, or at least passed, the previous classes.
Ah, yes...
"Of the 45 classes which were multimodal, 16 were 100-
level classes (35%), 5 were 200-level (11%), 12 were 300-level
(27%), and 12 were 400-level (27%). For comparison, in the
full set of 778 classes, 171 were 100-level (22%), 165 were
200-level (21%), 243 were 300-level (31%), and 199 were
400-level (26%)."
How about we take a closer look at those 100 level classes, hmmm?
- nerdponx 10y agoI remember my real analysis professor explicitly telling us that he ran the numbers on one of our exams and found bimodality. Real analysis is not what I would call an earlier class. I'm not sure if we were an outlier or a representative data point, however.
- trendia 10y agoIf there are two major topics in a test (say Topic 1 and Topic 2), then bimodality could arise simply because * some people studied both Topic 1 and Topic 2 * some people studied Topic 1 more than Topic 2 * some people studied Topic 2 more than Topic 1 This would cause bimodality even when inherent "genetic" skill is the same.
- sqeaky 10y agoThis seems unlikely across multiple students and years (though it is possible so more than one schoool should be studied). You comment also presumes there are no students who can study well enough to pass all exams. Considering the ease of 100 level courses CS courses acing that and another 100 level is not exactly hard.
- elcritch 10y agoIf this were be turned into a more rigorous MCMC style simulation and fed basic societal trends of high school and early stage college on courses taken, interest, aptitude, etc you might be able to get an estimate on the size of effect of these factors. Hmmm...
- sqeaky 10y agoI think the idea is that people on the lower mode of grading would self select themselves out of a CS at the 100 most often. This reduces the bimodality for the 200 level. Where again students self select themselves out, then the 300 level bi-modality is even further reduced. I think the 100 level is the place where such a bimodality is most likely to exist and investigation ought to be focused there.
- throwaway729 10y agoYour parent's point is that this hypothesis ("bimodality reduces as students progress through the curriculum" is possibly contradicted by the fact that many late-stage mathematics courses are strongly bimodal. (FWIW my analysis course was also bimodal.)
- ghaff 10y agoBased on some limited experience upper-level math and (I assume) physics probably have a stronger element of "get it" vs. "don't get it" than most majors. Way back when I was an undergrad a number of the math majors I knew considered it to be a relatively easy major and there were definitely people who pretty much breezed right through. At the same time, I was quite convinced that I could no more have successfully graduated as a math major--no matter how hard I worked--than I could have successfully flown through the air by flapping my arms. By contrast, I'm reasonably confident that I could have gotten through pretty much any other majors, whether engineering or something else.
- btilly 10y agoI can easily believe it was representative. I would expect ability driven bimodality to show up in courses that present new types of challenges that were not in previous courses. That is where you'll get students who either do or don't master key concepts, and where they go from there depends on their mastery of those concepts. For computer science, one of those key concepts is reasoning about state manipulated through a layer of indirection. The infamous "getting" pointers issue. In the case of real analysis, it is an issue of switching from "Can you apply known operations to produce the right answer?" to "Do you understand the structure of the reals well enough to prove it?".
- wutbrodo 10y ago> n the case of real analysis, it is an issue of switching from "Can you apply known operations to produce the right answer?" to "Do you understand the structure of the reals well enough to prove it?". Is this really the case in general? My math degree curriculum started with 100% proof-driven classes almost immediately, long before most people got around to taking real analysis. It was my impression that that kind of approach was fairly ubiquitous.
- btilly 10y agoIn the USA and Canada, it is standard for the professor to stand at the board and present proofs of everything, but students are not expected to understand them. If you can learn the formulas and apply the techniques that are in the homework sets, you can pass the class. I strongly question the value of having the professor recite proofs that the students do not really understand. However it is traditional to do that. The first course where students are expected to write their own proofs varies. My personal experience was that the transition happened in third year courses aimed at math majors. So I began writing proofs in abstract algebra and real analysis. But not in my third year differential equations course that was required for engineering and physics majors. When I was in grad school at Dartmouth, they introduced it earlier in a linear algebra course. I taught the last linear algebra course that did that, the next quarter they took proofs out of it.
- 10y ago
- ska 10y agoaside: real analysis classes are rarely large enough to do a good analysis of this in, unless you incorporate many years.
- lebca 10y agoWhile real analysis alone is probably not enough to do a real representative analysis, if the class were the first real analysis class in the undergrad sequence, then I'd call it an earlier class. Eg, 1st upper division real analysis class, assuming the lower divs were the ones the pre-meds and CS majors took.
- tamana 10y ago100 level classes werent substantiallly more often bimodal than the others though.
- mcguire 10y ago9% vs. 3%, 5%, and 6%.
- throwaway729 10y agoThe earlier classes are exactly the place where things like prior experience and level of interest can possibly explain bimodality. In which case bimodal grades exist, but the conclusions you can draw from their existence are pretty mundane (e.g., turns out you do better if you had a programming class in high school... surprise!) and sufficiently varied that it'd be hard to come up with any compelling interpretation of the data. There's a survivor-ship bias in later courses. The extent of that bias can only be determined by looking at attrition rates. But it's far easier to predict and measure the major threats to validity for data in later courses. So, if I were interested in the question "Are some people just naturally better at CS than others", I would either focus on later courses and try to determine the extent of survivor bias, or else I would look holistically at the entire curriculum. But I definitely wouldn't give a lot of weight to 100-level courses.
- taneq 10y agoIn my own experience, later courses (in computer science specifically) tend to erase the bimodal distribution because your ability to do science related to computing is almost orthogonal to your ability to actually build something with computers. Some of the people who graduated with honours alongside me could not code their way out of a paper bag if there was an exit_paper_bag() instruction.
- Jtsummers 10y ago> The earlier classes are exactly the place where things like prior experience and level of interest can possibly explain bimodality. I saw this a lot at GT. There, many students had to take the introductory programming course at the time (all engineering and sciences? circa 2000 if someone wants to help me remember). There was a great disparity between those of us who programmed in HS (or earlier) and those who didn't. What isn't clear is whether the poor grades were due to a lack of aptitude for the material, or a lack of skill on the faculty's part in presenting and educating, or a lack of interest or focus from those particular students (given it was their first and last CS course and they had to deal with the rest of the hell that was GT's first year).
- 10y ago
- Retric 10y agoA more obvious consideration is upper level classes have smaller sample sizes. They defaulted to 'not binomial' which creates a very strong bias in their methods. Even then they found a statistically significant results across a range of samples, thus invalidating their conclusion. The issue seems to be a failure to understand statistical analysis. The possible results are probably Yes or inconclusive. PS: You can also hide bi-modal distributions by averaging several offset distributions together. IF class A average is 70 with 2 peaks at 60 and 90 and class B average is 80 with two peaks at 70 and 90. You get four weak peaks at 60, 70, 80, and 90. Now repeat for a range of averages and it's going to look like a bell curve.
- xapata 10y agoMaybe the group as a whole is a normal distribution and your small samples made it look bimodal.
- SilasX 10y agoBut the 300/400 are almost as high.
- jknoepfler 10y ago100-level: 16/171 = 9.4% 200-level: 5/165 = 3.0% 300-level: 12/243 = 5.0% 400-level: 12/199 = 6.0% The evidence supports the claim that 100-level classes are relatively more likely to have bimodal grade distributions than upper-division courses, but does not support the claim that they are likely to have bimodal grade distributions (and we would want to compare csci to other 100-level classes if we thought there was something particularly problematic about entry-level csci education). By all means let's get more data, but entry level csci courses do not in general have bimodal grade distributions according to the data. Having TA'd low-level csci courses, I would conjecture that entry-level courses in general are taught by less talented teachers, tend to be graded more sloppily due to sheer work-load, also have a high percentage of people who are absolutely whacked out of their minds than upper division courses.