4 ms·
I think there’s a silver lining to all of this behavior in that it demonstrates that nothing really matters when it comes to determining if you’ll be successful
by Spivak 6y ago
I think there’s a silver lining to all of this behavior in that it demonstrates that nothing really matters when it comes to determining if you’ll be successful in college.
Test scores don’t prove much except who had the resources, time, and motivation to study the most. You could replace the SAT and ACT with obscure movie trivia and you’d see roughly the same distribution of scores and it would have the same predictive power. The people who signal that they’re willing to put it a lot of time, money, and effort into their education do well… surprised pikachu.
There’s no such thing as qualified for college outside of a genuine desire and motivation to do it.
So I don’t see any sort of contradiction in colleges admitting people based on novelty, coolness, and straight-up effort.
- yasp 6y ago>Test scores don’t prove much except who had the resources, time, and motivation to study the most. I was under the impression that SAT prep doesn't move the needle much. Am I mistaken?
- Spivak 6y agoCramming for the test right at the end with SAT prep will add a few points but won’t do anything dramatic. But if you get put in the “honors” track of a lot of high schools where the name of the game is to teach material informed by the SAT, ACT, AP, and IB teats then you almost can’t help but do well since you’ve been cramming for 4 years.
- malandrew 6y ago> since you’ve been cramming for 4 years. You could say the same for pretty much every educated person who has done an undergraduate or postgraduate degree. Seems like a lot of human progress has been made as the result of people that have been "cramming for 4 years"
- zeroonetwothree 6y agoAny evidence to support this?
- hackinthebochs 6y agoIt turns out actually learning the material on a test over the span of a few years helps you do well on the test. That used to be called getting an education.
- Spivak 6y agoRight! But the problem is that you don’t actually get much of an education along the way. You get a bunch of not super useful knowledge that you’ve almost surely forgotten and some test taking skills. This is the downfall of so many programs that teach to the test.
- hackinthebochs 6y agoThe problem with this reasoning is that the SAT isn't an arbitrary test. Presumably the course material came before the SAT was developed to test mastery of the material. Sure, the course material then changes to better capture what the SAT measures, and the SAT adjusts in kind. But this adversarial process doesn't optimize arbitrarily. Learning SAT material (rather than say learning tricks) is learning substantial math and reading skills, the kind that serves you well in college. So characterizing this as anything other than getting an education is disingenuous.
- intended 6y agoTeaching the test and getting an education are not the same.
- recursive 6y ago> cramming for 4 years. That's not called cramming. It's called "learning". It means the test is working as intended.
- zeroonetwothree 6y agoThat’s right, the average effect of test prep is around 0 increase.
- csa 6y agoYou are greatly mistaken, although it does depend on the quality of the preparation. I have seen scores improve 100-200 points per skill on average for middle range scores, and 50-100 points per skill for higher range scores with quality preparation. Reasons: - familiarity with test format - improved test taking strategies - familiarity with test content - developing the mental stamina to perform at a high level throughout the relatively long test - lowered anxiety and (often) increased confidence
- yasp 6y agoIs this just personal anecdata?
- csa 6y agoAn acquaintance of mine runs a high end SAT training program. He gets these results reliably for folks who have had little or no preparation before coming to him. Trained test takes is in the hundreds (maybe more). Is this data or anecdata? You be the judge. He finds it easy to bank on professionally. I encourage you to talk to someone who has worked at a high-end SAT training program (not Kaplan or that type). They can tell you the real deal, both successes and failures. Don’t rely on talking to the businesses themselves, because they will be selling their services rather than telling the complete truth (unless you know them personally). Fwiw, failures are usually due to one of a few factors: 1. anxiety 2. learning blocks 3. physical issues (e.g., lack of sleep, sick, etc.).
- georgeecollins 6y agoThe SAT goes from 200 - 800. If test prep raises average score by 100 points, there still is some room for the test to show actual knowledge. The college board says that an SAT is better predictor of success in college than GPA, which based on my experience of American high schools makes sense. I get that wealth probably has a positive correlation to both. But it seems that should matter a little.
- hackinthebochs 6y agoWhy do you exclude learning the material as a reason? My test prep was largely a matter of learning material that I missed or wasn't taught effectively during school.
- mattmcknight 6y ago>Test scores don’t prove much except who had the resources, time, and motivation to study the most. Aren't colleges looking for people who will study the most? Who have the motivation and the ability for the motivation to translate into results?
- Spivak 6y agoYes! That’s pretty much the point. The ACT and SAT are really good at finding some of those people but there’s a lot a lot a lot of type two errors. Letting people demonstrate their motivation in other ways and not immediately disqualifying them based on test scores goes a long way.
- malandrew 6y ago> Test scores don’t prove much except who had the resources, time, and motivation to study the most. Dunno about you, but even if this is true, something that shows you were highly motivated and took time to do something seems very valuable if your goal is to produce people what produce. In most areas of study, being motivated and investing time are key contributors to success. They aren't the only one. Intelligence, diversity of thought and resources matter too, but they certainly aren't negligible or dismissible.
- SeanAppleby 6y agoMy understanding is that SAT scores are significantly correlated with wealth (resources, time, externally imposed motivation), but not by as much as other admissions criteria, and that equity in educational attainment dramatically improved after standardized tests were introduced.