6 ms·
Psychometric Thresholds for Physics and Mathematics
- ZoFreX 16y agoI thought that it was much more interesting that they had hardly any data for students with a SAT-m under 600, which makes the conclusions slightly less convincing. That said, there is a clear wall in the data they have so far. It would definitely be interesting to look into this further and see if that is the case, and also investigate more fields (I didn't see anywhere in the paper a complete listing of all the subjects they compared, which was a pity). I know I would not be surprised if a similar pattern was found in Computer Science!
- dvse 16y agoWhy is a physics professor surprised by this? You will get exactly the same "step" plot directly from the binomial distribution if you assume independent trials and a linear dependency between the SAT band and the probability of getting an A in a course. If someone's probability of getting an A in a single course is 0.7 or above, the probability of getting at least 8 As out of 16 courses rapidly converges to 1, similar result holds for those with probability below 0.3. Nothing new has been shown here - can't believe they actually wrote a paper.
- Confusion 16y agoYou will get exactly the same "step" plot Except that they don't, for other majors than physics and mathematics.
- dvse 16y agoThey don't show it. The obvious explanation is that the grades in humanities are not as strongly correlated with SAT.
- quandrum 16y agoSo what you're say is, you didn't read the article?
- dvse 16y agoNotice that to get a "step" plot it is necessary to assume that probability of getting an A is strongly correlated with the SAT score. The paper says that for humanities there is no strong correlation. On the other hand, the "result" for physics is an elementary consequence of repeated trials (binomial distribution)
- carbocation 16y agoIt's not helpful to simply call the commenter out on not reading the article. First, it's unproductive, and second, it's merely conjecture. Perhaps you both read it but interpreted it differently? It would instead be more productive to point out why you think the person didn't read the article, thereby furthering discussion.
- deleted 16y ago[deleted]
- rflrob 16y agoI think independent trials is not an obviously good assumption. Any properly designed major will have later courses build on earlier ones, so one might have predicted that performance in the first course was more predictive of GPA than SAT score (though this isn't the only model that would lead to such a prediction). I, for one, am surprised that it appears to be so independent.
- Aqwis 16y agoFor curiosity's sake, how many percent of the students taking a typical college course in math or physics typically receive the grade A? (As you might guess, I'm not American.)
- nice1 16y agoThis has changed over the years; it is heading for 100% I believe.
- khermitian 16y agoIt varies by school and professor. I know several big schools suffer from grade inflation http://en.wikipedia.org/wiki/Grade_inflation#Grade_Inflation_in_the_United_States http://en.wikipedia.org/wiki/Grade_inflation#Grade_Inflation... In general, I think its usually a average of a B, at least at Northwestern University, but other people might have different experiences.
- Aqwis 16y agoThanks. For the record, the average grades for the courses at my university tend to be Cs (in the case of the big introductory courses, the average is usually closer to a D than a B), with about 10% of the students receiving As. This discrepancy is quite unintuitive; (intuitively) you'd expect that the grade "A" means about the same thing in two different university systems that use letter grades.
- khermitian 16y agoMy experience above is from discussions with professors in higher level classes. Im not too sure if that applies to intro levels. I think that once you reach a certain level of difficultly the grade does not really reflect how well you learn the material, but more of how ridiculously smart everyone else in the class is (see that most of the test averages come out to about 50% or less).
- tokenadult 16y agoI'm not sure how well the most comprehensive set of national statistics in the United States http://gradeinflation.com/ http://gradeinflation.com/ disaggregates statistics for students who pursue different majors. The college reported in the blog post submitted here, the University of Oregon, http://collegesearch.collegeboard.com/search/CollegeDetail.jsp?collegeId=3264&profileId=6 http://collegesearch.collegeboard.com/search/CollegeDetail.j... has an incoming class of students whose SAT and ACT score interquartile ranges are at about the national median for the college 25th percentile. There are not a lot of conspicuously high-scoring students at that college, so the study submitted here has the issue of restriction of range.
- tokenadult 16y agoFrom this blogger, I like much better his post on the distinction between rationality and IQ, http://infoproc.blogspot.com/2009/04/rationality-vs-intelligence.html http://infoproc.blogspot.com/2009/04/rationality-vs-intellig... a subject brought to popular attention especially by psychologist Keith R. Stanovich. http://www.project-syndicate.org/commentary/stanovich1/English http://www.project-syndicate.org/commentary/stanovich1/Engli... I should also point out that what is really relevant to success in a college course in physics or mathematics, even more than SAT score or some other IQ proxy, is specific subject matter background in science and mathematics. Whole countries do MUCH better than the United States in providing good background in science and mathematics to pupils in K-12 education, http://pirls.bc.edu/timss2007/PDF/T07_M_IR_Chapter1.pdf http://pirls.bc.edu/timss2007/PDF/T07_M_IR_Chapter1.pdf so much so that the United States median achievement level is only at the bottom quartile level for those countries, or (from another point of view) the United States top quartile level of achievement is only at the median level for those countries. I think United States policy-makers ought to devote a lot more time to thinking about how to learn from those good examples. Some United States mathematicians have taken care to look at how badly mathematics is taught to elementary pupils in the United States http://www.ams.org/notices/200502/fea-kenschaft.pdf http://www.ams.org/notices/200502/fea-kenschaft.pdf http://math.berkeley.edu/~wu/Lisbon2010_4.pdf http://math.berkeley.edu/~wu/Lisbon2010_4.pdf http://www.aft.org/pdfs/americaneducator/fall1999/amed1.pdf http://www.aft.org/pdfs/americaneducator/fall1999/amed1.pdf and have suggested reforms. http://hub.mspnet.org/index.cfm/13083 http://hub.mspnet.org/index.cfm/13083
- temphn 16y ago> I should also point out that what is really relevant to success in a college course in physics or mathematics, even more than SAT score or some other IQ proxy, is specific subject matter background in science and mathematics. But this is not meaningful without controlling for IQ. What allows you to achieve "subject matter background in science and mathematics"? > the United States median achievement level is only at the bottom quartile level for those countries And this is not meaningful without controlling for ethnicity. Disaggregated results show that Americans of European descent are competitive with Europeans, Americans of Asian descent competitive with East Asians, and so on. http://iowahawk.typepad.com/iowahawk/2011/03/longhorns-17-badgers-1.html http://iowahawk.typepad.com/iowahawk/2011/03/longhorns-17-ba... http://iowahawk.typepad.com/iowahawk/2011/03/badgering-the-witless.html http://iowahawk.typepad.com/iowahawk/2011/03/badgering-the-w... http://hackerne.ws/item?id=2463278 http://hackerne.ws/item?id=2463278 In the last link, yummyfajitas seems to have noted this particular point to you before.
- j_baker 16y agoAs always, it's important to note that correlation does not imply causation. Do students with higher SAT-M scores make better physicists, or do physics programs reward students who are better test-takers?