4 ms·
One of the most-cited stats regarding literacy is: a student who is not reading at grade level by the end of 3rd grade is 300% as likely to flunk out of school
by gnicholas 5y ago
One of the most-cited stats regarding literacy is: a student who is not reading at grade level by the end of 3rd grade is 300% as likely to flunk out of school before finishing 12th grade.
As someone who works in literacy, I have seen this cited many times and referenced it several times myself. It was only this year, when I was reading Scout Mindset [1] that I realized this statistic doesn't say what so many people think it does.
People cite this stat to prove how important literacy is. After all, if a student can't read, then he is not going to be able to pass classes in a wide variety of subjects. This notion of causality is captured in the similarly-common saying "first you learn to read, then you read to learn".
But the stat doesn't prove causality at all. And when you step back and think about it, there is likely to be a very large overlap between people who have low reading ability and people who are more likely to drop out of school. This is perhaps obvious to people who do not work in literacy, where we tend to overestimate its importance.
For me, this was a perfect example of confirmation bias, where people — even people who are generally smart and well-meaning — credulously accept (or even tout) statistics without first analyzing them. Had we seen a stat that indicated that reading ability didn't affect educational outcomes, we surely would have dug in and tried to figure out what was wrong with the calculation. But this one sounded right, so now it's part of the accepted wisdom in the world of literacy. This statistic is cited wherever someone is asking for more money to be poured into early literacy programs, as if solving literacy will have this 300% multiplier effect.
I thought about posting about this on LinkedIn, and urging others to try to think about what beliefs are common in their industry, but have not been thoroughly examined. It would be great if we could call out some of these common-but-untrue beliefs, which may lead to misallocation of resources.
1: https://www.amazon.com/Scout-Mindset-Perils-Defensive-Thinking/dp/0735217556 https://www.amazon.com/Scout-Mindset-Perils-Defensive-Thinki...
- jasone 5y ago300X is 30000%. Which do you mean? (300X or 300%)
- gnicholas 5y agoSorry — meant to put 300% in the first time; I only got it right in my second mention. Fixed in original; thanks for flagging.
- galaxyLogic 5y ago> But the stat doesn't prove causality at all Does it prove that there is no causality?
- dredmorbius 5y agoDistinguishing correlation and causation is the constant challenge and peril of all social science research, where mechanisms are complex and measurements indirect. There are a few methods which do offer some insight, the two most effective I'm aware of being identical-twin studies and qualification-test cut-off divisions. In twin studies, the goal is to study twins (identical genetic inheritence) either from the same household (similar socioeconomic environment) or separate ones (often foster-parent settings or other forms of adoption), and comparing life trajectories, educational attainment, and employment history. I'm not specifically aware of education-related studies of this form, though I'd strongly recommend literature search (Google Scholar, etc.) on keywords such as "twin studies education". On test-cutoff studies, there was one I ran across recently in which individuals who tested just at the cutoff of the qualification threshold for advanced academy entrance. That is, students scoring above the threshold attended the schools, those below did not. The findings were of comparable subsequent lifetime attainments (employment, income), suggesting that innate ability was a stronger predictor than educational history. I can't find the study presently, though I'm pretty certain it addressed the Specialised High Schools Admission Test (SHSAT): https://en.wikipedia.org/wiki/Specialized_High_Schools_Admissions_Test https://en.wikipedia.org/wiki/Specialized_High_Schools_Admis... Far more studies look at basic demographic or geographic data. To a large extent this constitutes an availability heuristic: the data are far more abundant and more readily available. How predictive they are on a causality basis is harder to determine. One example (turned up whilst searching for the entrance-exam study): "Money, Race and Success: How Your School District Compares" (2016) https://www.nytimes.com/interactive/2016/04/29/upshot/money-race-and-success-how-your-school-district-compares.html https://www.nytimes.com/interactive/2016/04/29/upshot/money-... Another school of thought (so to speak) is on what education's impact socially is, at least along economic-performance measures. (There are of course other legitimate outcomes of education, including its roles in culture and democratic institutions.) Such viewpoints often come from the right, though may also be found among more liberal economists. One such, Ha-Joon Chang addresses this in chapter 17 of 23 Things They Don't Tell You About Capitalism, "More education itself is not going to make a country richer" (2010). Dr. Ha-Joon notes that: 1. Many poor countries have high educational attainment. 2. Many rich countries have comparatively low attainment. 3. Numerous countries (particularly in east / southeast Asia) have made remarkable economic progress without especially high educational attainment. 4. Mechanisation has a far greater impact on per-worker productivity than education. 5. Businesses generally prefer de-skilling work in order to make labour more substitutable. This of course reduces the benefits of education. Additional points (Ha-Joon does not address these directly) are that infrastructure counts for a great deal, and "brain drain" --- economic migration by the more educated --- can siphon off a country's most educated citizens, essentially subsidising the economies of other countries. See: https://www.worldcat.org/title/twenty-three-things-they-dont-tell-you-about-capitalism/oclc/1090920534 https://www.worldcat.org/title/twenty-three-things-they-dont... Among Ha-Joon's more interesting citations: L. Pritchett, "Where has all the education gone?", The World Bank Economic Review, 2001, vol. 13, no. 3. https://documents.worldbank.org/curated/en/859821468180273788/pdf/773740JRN020010l0the0Education0Gone.pdf https://documents.worldbank.org/curated/en/85982146818027378... (PDF) Harry Braverman, Labor and Monopoly Capital: The Degradation of Work in the Twentieth Century (1974) https://nyupress.org/9780853459408/labor-and-monopoly-capital/ https://nyupress.org/9780853459408/labor-and-monopoly-capita... Stephen Marglin, "What do Bosses Do?", published in two parts in The Review of Radical Political Economy, 1974, 1975. https://scholar.harvard.edu/marglin/publications/what-do-bosses-do https://scholar.harvard.edu/marglin/publications/what-do-bos... https://scholar.harvard.edu/marglin/publications/what-do-bosses-do-part-ii https://scholar.harvard.edu/marglin/publications/what-do-bos...
- etempleton 5y agoCorrect. A lack of basic literacy by third grade is an indicator something else is wrong. Children will typically just learn to read with enough exposure to language by this age. Often this either indicates that a child has a learning disability or basic needs at home are not being met. You can pour all the money you want into literacy, and that is fine and a good thing, but it does not address the needs of a child who is not progressing because no one talks to them at home or there are other basic needs not being met.
- bsder 5y ago> Children will typically just learn to read with enough exposure to language by this age. Is this universally true? Or is it only true for certain socioeconomic classes? One of the biggest problems in education is the fact that during the summer vacation some students improve while others degrade. The differential is almost completely predictable by socioeconomic class.
- bawolff 5y agoI would assume that sufficient exposure is what varries with class. The way you're phrasing that seems to imply that some classes are just instrinsicly not as smart, which i don't think is true.
- michaelt 5y agoI didn't get that implication from bsder at all. Seems to me their post implies all students learn during term time, showing there's nothing wrong with any of them. And anything outside of term time is extracurricular; everyone knows more extracurricular activities need more parental time and money.
- sokoloff 5y agoI took the exact opposite reading: that socioeconomic conditions (rather than inherent abilities) were the first-order difference.
- marcusverus 5y ago
- SagelyGuru 5y agoThis is unfortunately just one of many examples of generally widespread malaise of conflating correlation with causality. It is especially common in certain "sciences" which typically involve a lot of data collection. Followed by attempts to crunch it up into some kind of popular and far reaching conclusions, intended to fool the examiners into awarding a PhD.
- nathan_compton 5y agoSpeaking as a person with a PhD, I can say from personal experience that you don't need popular or far reaching conclusions to earn one. Most of the time the committee wants to see you've done the work and have, in some small way (sometimes surprisingly small) pushed the boundaries of knowledge out a bit. The kind of Academic Inflation you're talking about is almost entirely the product of PIs who need to publish, publish, publish to get tenure and funding. The vast majority of people who are awarded PhDs understand they have almost no chance of even landing a tenure track position and consequently have little incentive to fluff up their work.
- torginus 5y agoWell it's statistically likely that the students who don't do well on reading comprehension might struggle with other things too, but it's not like reading is not a foundational skill for being able to do well later in school. One outlying example is dyslexics - one can be arbitrarily bright, but have enormous difficulty reading - I've personally known extremely intelligent people who struggled finishing high school because of their poor reading comprehension - this is something that ought to be remedied. I'd say it's far more likely these students struggle academically - but the problem is that the further they fall behind, the more of an uphill battle for them to keep up with the class, let's say X takes 50% more time to solve a text-based math problem than his peers, but due to his poor reading comprehension he takes again 50% more time just to understand the problem - which might make the difference between failing and passing. And as lacking as public schooling is, I'd expect them to do their damnedest that people leave school with at least basic reading comprehension after 12 years of education.