14 ms·
Aren't final grades often "curved", i.e. re-graded according to rank? That would explicitly destroy bimodality, making the final grade distribution consist of n
by nerdponx 10y ago
Aren't final grades often "curved", i.e. re-graded according to rank? That would explicitly destroy bimodality, making the final grade distribution consist of non-iid order statistics.
Also, it's commendable that they point out that they expect 5% false positives, but frustrating that they don't go further and explicitly plan for a multiple testing correction procedure. It seems that they don't need it to fail to reject the null "meta-hypothesis", but still.
- mcguire 10y agoThe curving process should be linear, I think.
- tamana 10y agoThat sounds funny, but it's true under the common modern curving regime that is really just lowering the bar for raw score to letter grade conversion, not forcing a bell curve.
- turnip1979 10y agoSquare root of grade times 10 :-p
- matteotom 10y agoI've seen a few different curving processes: 1. Formula, like square root of grade times 10, that's designed to bring up grades. There're a lot of possibilities here 2. Top x% get A's, next y% get B's, etc 3. Look for clusters: top cluster gets A's, next B's, etc These can also be applied to classes as a whole or individual assignments and tests
- BeetleB 10y agoThe curving process shouldn't exist. If you make an exam that is difficult enough to need curving, you're getting a poor measure of ability. This is because exams ask only a few questions, and unreasonably difficult exams result in low scores even from high achieving students. Low scores are very susceptible to noise (the delta between 50% and 60% is greater than between 85% and 95%). If that doesn't convince you, take my argument to the obvious extreme. The Putnam Competition in mathematics is tough. Sometimes over half of the people score 0. Getting 1 question correct (out of 12) at times puts you in the top 20%. Imagine I gave this as an exam to a math class of 20 students. One person scores a 1. The rest score 0. Is it meaningful to curve this? I could correct by giving partial credit: Some people get 0.25, others 0.5, and others 0.75, so we now have 5 different grades. Should I just give A, B, C, D and F? The lower the scores, the higher the effect of noise. It's a bad idea.
- smallnamespace 10y ago> Low scores are very susceptible to noise (the delta between 50% and 60% is greater than between 85% and 95%) This seems untrue from information theory. The entropy of a question is maximized when its probability of being answered correctly is exactly 50% [1]. If your only goal is to have the least amount of measurement noise given a fixed number of questions, then you'll want each question to be hard enough to filter 50% of the class out, and to minimize the correlation between questions. For example, 10 independent 50% questions reveals as much information as 16 independent 85% questions. > Imagine I gave this as an exam to a math class of 20 students. One person scores a 1. The rest score 0. Is it meaningful to curve this? You're looking at only 1 tail but ignoring the other. By symmetry, a question that only 1 person gets correct tells you exactly as much as a question that 19 get correct. An exam with a 90% pass rate (before curving) is no better than a 10% exam. [1] https://en.wikipedia.org/wiki/Binary_entropy_function https://en.wikipedia.org/wiki/Binary_entropy_function
- mcguire 10y agoThanks. I'm now having flashbacks to the summer of 1990, when I worked on a Education professor's research project, creating a math test in a Hypercard stack that presented the question that provided the most information about the testee's abilities, given their previous answers.
- smallnamespace 10y agoThe computerized GMAT and LSAT attempt to do this - the difficulty level of questions dynamically adjust to your current performance level (higher means harder questions).
- BeetleB 10y agoFirst, while you may have a point, you misunderstood my percentages. I did not mean them to be the pass rate, but rather the score. > An exam with a 90% pass rate (before curving) is no better than a 10% exam. I do not encourage a 90% pass rate. I do not endorse exams where most of the students score 90%. I'm saying an exam which allows for a large variation in scores (anywhere from 10 to 100) yields more information, whereas an exam where a really brilliant student will get 50, with the next highest score being a 30 by someone who is only very smart, tends to be less likely to yield useful information about most of the students who will get 20 or less. A fairly bright student and a fairly average student may both score a 20 on such a test - yet the test failed to distinguish between them. (BTW, I had an instructor whose exams were like this - I think I once had the highest score at around 25-30 out of 100). A less demanding, but not trivial test, will separate out the average from the brighter. Regardless, why the need for a curve? Your grading system should not depend on which students are present. It can lead to poor students getting a good grade and smarter students getting a poorer grade - in different semesters, for the very same tests.
- Bartweiss 10y agoBut I've seen a lot of courses where it isn't. Among the many techniques I've seen used: - Raw average, then set letter cutoffs for a normal distribution across students. Arbitrary on distribution, normal on letter. - "Skew high" by counting missed points more weakly as you miss more. Inflated letters with a score-accurate relative distribution. - "Fixed and curved", where each cutoff is based on the more (or less!) generous of standard deviations and 'conventional' grade brackets: the floor for A is either 92%+ or +2 SD from mean, B is 83%+ or +1 SD, etc. Bizarre and distorted everything, since the relevant cap is determined by the local distribution. - God knows what else. So honestly, I think post-curve data is a hopelessly course-specific, nonlinear mess.
- Bartweiss 10y agoNot only are they curved, different courses are 'curved' according to vastly different rules. Some curve percentages, some curve only letters, and different distributions are enforced for different classes. So if this is post-curve data, I would expect it to be basically worthless as a reflection of skill distribution.
- JoeAltmaier 10y agoYeah, lots of ways to fudge. One exam, my friend Brian and I were allowed to skip the final and take our grade. So the rest of the class could go from failing, to getting a grade on a curve. There was that much gap between us and the rest.
- spike021 10y agoMy Operating Systems course had a really odd grade curve. There was a listed one in the syllabus, but then the exams were so difficult that nobody was scoring above 80-85 out of 100, so there had to be an additional full grade curve after that. So yeah, post-curve isn't helpful. Unless there's some way to normalize the data.