5 ms·

This is a commonly repeated myth but it's untrue. For example, SAT coaching makes a minimal difference in test scores: https://www.jefftk.com/p/sat-coaching-wha

This is a commonly repeated myth but it's untrue. For example, SAT coaching makes a minimal difference in test scores: https://www.jefftk.com/p/sat-coaching-what-effect-size https://www.jefftk.com/p/sat-coaching-what-effect-size In contrast, holistic measures like looking at extracurriculars are much more correlated to wealth and social status.

throwkeep 5y ago
That myth comes from the test prep industry, which makes exaggerated claims about their importance. "Once scholars control for all these factors as best they can, they find that coaching has a positive but small effect: Perhaps 10 or 20 points in total on the SAT, mostly on the math section, according to careful work by Derek Briggs of the University of Colorado Boulder and Ben Domingue of Stanford University. ...a 20-point improvement to a score in this range would have no practical meaning for students who are trying to get into more selective schools. Even when it comes to less selective schools, just 20 percent of the counselors said a boost from 430 to 450 would make a difference. In other words, research has debunked the myth that pricey test prep gives a major bump to students’ scores, but it’s also hinted that whatever modest bumps they do provide are more likely to help the people who are already at the top." https://slate.com/technology/2019/04/sat-prep-courses-do-they-work-bias.html https://slate.com/technology/2019/04/sat-prep-courses-do-the...
deleted 5y ago
[deleted]
bsder 5y ago
> For example, SAT coaching makes a minimal difference in test scores I really don't understand how this statement is even remotely true. The only thing I can think of is that "coaching" is too broad--ie. includes both students who spend 100+ hours and students who spent an hour at a talk by the guidance counselor. Doing nothing other than taking a couple sample tests has to net you a bunch of points because you don't have to waste time reading the directions. Simply drilling basic mathematics so I could do "1+1" and come up with 2 regularly netted me almost 250 points in Math (standardized tests like the SAT are really nasty about having answers that match the common mistakes). Going through 6000 vocabulary words pulled my verbal up almost 250 points (and had a dramatic effect on my writing). But that's far beyond "coaching" ... that's a multi-year commitment.
- MikeUt 5y ago
  You're comparing coaching to not preparing at all. The question is how much more effective is preparation with a coach, versus the same amount of preparation without one.
- renewiltord 5y ago
  That's practice, right? Coaching would be practice directed by a tutor.
  - naturalauction 5y ago
    Coaching can help kids who otherwise wouldn't have the discipline to practice themselves (SAT prep is very boring).
paxys 5y ago
People always point to coaching to refute this argument but that isn't really what makes the difference. I never had any professional coaching for the SAT, but I did have: - Access to unlimited test prep material (from College Board, Princeton Review, Kaplan, others). Each book was $100+, and I must have easily spent a few thousands on books, sample tests, vocabulary lists and other material. - A laptop and stable internet connection. - My own quiet and comfortable room to study in. - No other real responsibilities taking up my time. I didn't have to cook or take care of younger siblings. Didn't have to work part time jobs after school and late into the evening/night. - Access to private counselors through my school which was in an expensive and well-funded school district. All of this made a huge different to my test score, and I don't see how anyone can argue that someone in a worse financial condition won't be adversely affected.

throwkeep 5y ago

That myth comes from the test prep industry, which makes exaggerated claims about their importance. "Once scholars control for all these factors as best they can, they find that coaching has a positive but small effect: Perhaps 10 or 20 points in total on the SAT, mostly on the math section, according to careful work by Derek Briggs of the University of Colorado Boulder and Ben Domingue of Stanford University. ...a 20-point improvement to a score in this range would have no practical meaning for students who are trying to get into more selective schools. Even when it comes to less selective schools, just 20 percent of the counselors said a boost from 430 to 450 would make a difference. In other words, research has debunked the myth that pricey test prep gives a major bump to students’ scores, but it’s also hinted that whatever modest bumps they do provide are more likely to help the people who are already at the top." https://slate.com/technology/2019/04/sat-prep-courses-do-they-work-bias.html https://slate.com/technology/2019/04/sat-prep-courses-do-the...

deleted 5y ago

[deleted]

bsder 5y ago

> For example, SAT coaching makes a minimal difference in test scores I really don't understand how this statement is even remotely true. The only thing I can think of is that "coaching" is too broad--ie. includes both students who spend 100+ hours and students who spent an hour at a talk by the guidance counselor. Doing nothing other than taking a couple sample tests has to net you a bunch of points because you don't have to waste time reading the directions. Simply drilling basic mathematics so I could do "1+1" and come up with 2 regularly netted me almost 250 points in Math (standardized tests like the SAT are really nasty about having answers that match the common mistakes). Going through 6000 vocabulary words pulled my verbal up almost 250 points (and had a dramatic effect on my writing). But that's far beyond "coaching" ... that's a multi-year commitment.

MikeUt 5y ago
You're comparing coaching to not preparing at all. The question is how much more effective is preparation with a coach, versus the same amount of preparation without one.
renewiltord 5y ago
That's practice, right? Coaching would be practice directed by a tutor.
- naturalauction 5y ago
  Coaching can help kids who otherwise wouldn't have the discipline to practice themselves (SAT prep is very boring).

paxys 5y ago

People always point to coaching to refute this argument but that isn't really what makes the difference. I never had any professional coaching for the SAT, but I did have: - Access to unlimited test prep material (from College Board, Princeton Review, Kaplan, others). Each book was $100+, and I must have easily spent a few thousands on books, sample tests, vocabulary lists and other material. - A laptop and stable internet connection. - My own quiet and comfortable room to study in. - No other real responsibilities taking up my time. I didn't have to cook or take care of younger siblings. Didn't have to work part time jobs after school and late into the evening/night. - Access to private counselors through my school which was in an expensive and well-funded school district. All of this made a huge different to my test score, and I don't see how anyone can argue that someone in a worse financial condition won't be adversely affected.