3 ms·
The curving process should be linear, I think.
by mcguire 10y ago
The curving process should be linear, I think.
- tamana 10y agoThat sounds funny, but it's true under the common modern curving regime that is really just lowering the bar for raw score to letter grade conversion, not forcing a bell curve.
- turnip1979 10y agoSquare root of grade times 10 :-p
- matteotom 10y agoI've seen a few different curving processes: 1. Formula, like square root of grade times 10, that's designed to bring up grades. There're a lot of possibilities here 2. Top x% get A's, next y% get B's, etc 3. Look for clusters: top cluster gets A's, next B's, etc These can also be applied to classes as a whole or individual assignments and tests
- BeetleB 10y agoThe curving process shouldn't exist. If you make an exam that is difficult enough to need curving, you're getting a poor measure of ability. This is because exams ask only a few questions, and unreasonably difficult exams result in low scores even from high achieving students. Low scores are very susceptible to noise (the delta between 50% and 60% is greater than between 85% and 95%). If that doesn't convince you, take my argument to the obvious extreme. The Putnam Competition in mathematics is tough. Sometimes over half of the people score 0. Getting 1 question correct (out of 12) at times puts you in the top 20%. Imagine I gave this as an exam to a math class of 20 students. One person scores a 1. The rest score 0. Is it meaningful to curve this? I could correct by giving partial credit: Some people get 0.25, others 0.5, and others 0.75, so we now have 5 different grades. Should I just give A, B, C, D and F? The lower the scores, the higher the effect of noise. It's a bad idea.
- smallnamespace 10y ago> Low scores are very susceptible to noise (the delta between 50% and 60% is greater than between 85% and 95%) This seems untrue from information theory. The entropy of a question is maximized when its probability of being answered correctly is exactly 50% [1]. If your only goal is to have the least amount of measurement noise given a fixed number of questions, then you'll want each question to be hard enough to filter 50% of the class out, and to minimize the correlation between questions. For example, 10 independent 50% questions reveals as much information as 16 independent 85% questions. > Imagine I gave this as an exam to a math class of 20 students. One person scores a 1. The rest score 0. Is it meaningful to curve this? You're looking at only 1 tail but ignoring the other. By symmetry, a question that only 1 person gets correct tells you exactly as much as a question that 19 get correct. An exam with a 90% pass rate (before curving) is no better than a 10% exam. [1] https://en.wikipedia.org/wiki/Binary_entropy_function https://en.wikipedia.org/wiki/Binary_entropy_function
- mcguire 10y agoThanks. I'm now having flashbacks to the summer of 1990, when I worked on a Education professor's research project, creating a math test in a Hypercard stack that presented the question that provided the most information about the testee's abilities, given their previous answers.
- smallnamespace 10y agoThe computerized GMAT and LSAT attempt to do this - the difficulty level of questions dynamically adjust to your current performance level (higher means harder questions).
- BeetleB 10y agoFirst, while you may have a point, you misunderstood my percentages. I did not mean them to be the pass rate, but rather the score. > An exam with a 90% pass rate (before curving) is no better than a 10% exam. I do not encourage a 90% pass rate. I do not endorse exams where most of the students score 90%. I'm saying an exam which allows for a large variation in scores (anywhere from 10 to 100) yields more information, whereas an exam where a really brilliant student will get 50, with the next highest score being a 30 by someone who is only very smart, tends to be less likely to yield useful information about most of the students who will get 20 or less. A fairly bright student and a fairly average student may both score a 20 on such a test - yet the test failed to distinguish between them. (BTW, I had an instructor whose exams were like this - I think I once had the highest score at around 25-30 out of 100). A less demanding, but not trivial test, will separate out the average from the brighter. Regardless, why the need for a curve? Your grading system should not depend on which students are present. It can lead to poor students getting a good grade and smarter students getting a poorer grade - in different semesters, for the very same tests.
- Bartweiss 10y agoBut I've seen a lot of courses where it isn't. Among the many techniques I've seen used: - Raw average, then set letter cutoffs for a normal distribution across students. Arbitrary on distribution, normal on letter. - "Skew high" by counting missed points more weakly as you miss more. Inflated letters with a score-accurate relative distribution. - "Fixed and curved", where each cutoff is based on the more (or less!) generous of standard deviations and 'conventional' grade brackets: the floor for A is either 92%+ or +2 SD from mean, B is 83%+ or +1 SD, etc. Bizarre and distorted everything, since the relevant cap is determined by the local distribution. - God knows what else. So honestly, I think post-curve data is a hopelessly course-specific, nonlinear mess.