2 ms·
SAT is a bad example because SAT prep works very poorly. People like to cite anecdotes (which are driven by the noise of retesting until an extreme score is rea
by gwern 12y ago
SAT is a bad example because SAT prep works very poorly. People like to cite anecdotes (which are driven by the noise of retesting until an extreme score is reached and selection effects) and prep companies like to cite how 'students who took our course scored 200 points higher than those who didn't', but that's driven by the obvious confounding of who goes through with prep courses; estimates from the randomized experiments tend to look more like 20 points (see https://en.wikipedia.org/wiki/SAT#Preparation https://en.wikipedia.org/wiki/SAT#Preparation and reviews like http://libgen.org/scimag/get.php?doi=10.1111%2Fj.1468-2397.2011.00812.x http://libgen.org/scimag/get.php?doi=10.1111%2Fj.1468-2397.2... ).