4 ms·
I'm all for installing air filters in classrooms for a number of reasons, but I also think the extreme results from this study aren't going to hold up to furthe
by Aurornis 2y ago
I'm all for installing air filters in classrooms for a number of reasons, but I also think the extreme results from this study aren't going to hold up to further research.
From the paper:
> To do so, I leverage a unique setting arising from the largest gas leak in United States history, whereby the offending gas company installed air filters in every classroom, office and common area for all schools within five miles of the leak (but not beyond). This variation allows me to compare student achievement in schools receiving air filters relative to those that did not using a spatial regression discontinuity design.
In other words, the paper looked at test scores at different schools in different areas on different years and assumed that the only change was the air filters. Anyone who has worked with school kids knows that the variations between classes from year to year can be extreme, as can differences produced by different teachers or even school policies.
Again, I think air filtration is great indoors, but expecting test scores to improve dramatically like this is not realistic. This feels like another extremely exaggerated health claim, like past claims made about fish oil supplements. Fish oil was briefly thought to have extreme positive health benefits from a number of very small studies like this, but as sample sizes became larger and studies became higher quality, most of the beneficial effects disappeared.
- xattt 2y agoIf anything, schools able to implement air filtration and fresh air exchanges systems are likely those flush with cash and supportive parents.
- xwolfi 2y agoAnd the resulting backlash 10 years down the line ? I don't think science should be used that way: who would trust it eventually ? Would you support a small study saying a medicine or a vaccine produces a 20 year life expectancy increase, all that to end up 20 years later with no improvement, everyone on that medicine, and the anti-everything yelling on every platform that the big pharma lobby poisoned our children ? Even when the studies are on large samples, double-blind, long time range with a clear explanation as to why there's an effect, we have people trying to kill the resulting health campaigns. Don't encourage fake ones !
- eru 2y ago> I don't think science should be used that way: who would trust it eventually? There's no single party controlling 'science'. It's all just individuals many of them under 'publish or perish' rules.
- permo-w 2y agoin this case the filtration systems were installed on the dime of a local natural gas company after a leak, although that was as a result of the interference of interested parents
- calvinmorrison 2y agoonly ycombinator would have a hard time with the concept of 'open the window' and instead expect a capital installment of $2B to retrofit classrooms
- ajb 2y agoIn many areas the source of air pollution is outside. Opening windows helps with house dust and mold spores, but not with particulates from diesel, tyres or with pollen.
- lazyasciiart 2y agoYes, silly gas company, should just tell the local schools to open the windows and let the natural gas in. You have heard of air pollution, I assume. Some schools are in places that regularly have polluted air.
- do_not_redeem 2y agoDo you think everyone lives in California where there's comfortable sunny temperatures and no rain 360 days a year? Classic ycombinator post
- eru 2y agoGerman schools open their windows in winter. It's the classic German Stoßlüften in action. However, the air outside also has lots of dusts. Opening the windows does nothing for that, but air filtration can potentially help.
- dzhiurgis 2y agoWe did it too, but it was huge ceremony around it. Kids shouldn’t be begging and screaming “too cold” for fresh air.
- eru 2y agoThe ceremony is part of the fun. Though for us the ceremony was only one or two mild complaints from the kids near the window, and the teacher firmly stating that the room reeks of sweaty teenagers and needs some airing out.
- dzhiurgis 2y agoThese systems are not that expensive and save money. If parents would be allowed to contribute towards it like a 10year bond it would pay for itself…
- VladVladikoff 2y agoOne problem with nutrition based science is it suffers from nutrigenomics bias. It’s possible to study small cohorts of similar genetics and come to conclusions which fail to extrapolate to larger populations. It’s possible that this same problem does not apply to air filtration.
- ted_dunning 2y agoIt's possible, but much less likely since they controlled for demographics and cited a number of related studies that show comparable effects.
- mmooss 2y agoBased on your comment, the effect could be larger as well as smaller. All research is met on HN by people who know better and will tell you why it's flawed. There isn't a greater collection of expertise in the history of the world than on HN. Edit: I meant to add: What value can we find in this research? It wasn't published as scripture, the perfect answer to all our problems. It's one study of some interesting events and data; what can we get out of it?
- LorenPechtel 2y agoThings which reach the level of getting on here are basically always outliers. And is the outlier real or a false positive? There's a huge selection bias towards the false positives.
- bawolff 2y agoScience succeeds when people lean towards the side of cynicism instead of optimism. Scientific research should be read critically.
- mmooss 2y agoCritical thinking and skepticism are good, but much of what happens on HN is not that. Thinking critically includes, most of all, finding value - you need to think critically (and skeptically) to avoid assigning value to things that don't have it, but you must find value. The goal is to build knowledge - just like the study author needs to find knowledge among flawed data, you must find knowledge among flawed studies - and they are all flawed, of course. Focusing on the flaws and trying to shoot down everything is just craven recreation.
- Jensson 2y ago> Focusing on the flaws and trying to shoot down everything is just craven recreation. No, its a valuable job to find flaws because its much easier to fix and work on known flaws than to stumble in the dark. Removing flaws and problems is one of the easiest ways to add value.
- 7thaccount 2y agoI'm a big fan of air filters and have many in my own home that have made a big difference in quality of life as I live in a high pollen area. They can help with a lot more irritants as well that some students may be sensitive to (i.e., some students may study better if their immune system isn't in overdrive for half the school year like mine was). I'm not sure how these would help with natural gas though. I can't read the article due to paywall. Some VOCs can be filtered out (at least I think) with a baking soda filter ...those have to be changed more often than the HEPA filters (at least on my model that has one). Again, that should help with some scents (a major issue for me - even the dishwasher running can cause problems for me), but it isn't going to help if there is a gas leak (not sure if that is what the article is suggesting).
- LorenPechtel 2y agoThe gas was long gone, it wasn't being filtered. However, I don't see that it proves pollution is the cause. What about infection? Air filtration can reduce the spread of pathogens. Schools throw together a large pool of people, the bug of the day will go around. Less if there are good filters.
- maxerickson 2y agoThe article and study are both explicit that natural gas wouldn't have been an issue (the leak was fixed and the gas was gone). The impact from the filters would be from other indoor air pollutants.
- 7thaccount 2y agoThank you!
- pizzly 2y agoI'm not sure what it was but I remember learning where with a continuous runny noise in certain classes (buildings) with AC. Outside and different buildings were fine at least for me. In those effected buildings I estimate that 5% were also effected by hearing people sniff every minute or so. This definitely caused distraction while learning. A good filter on the AC would properly have solved this.
- MPSFounder 2y agoI wish we made more efforts to check air quality. I went to a great school, and the water filter hadnt been replaced since 2005 (it was 2012 at the time, and filters were supposed to be replaced every 6 months). My point is people take it for granted that air quality or water quality in the US is great, but if we checked, I bet most of us are exposed to cancerous materials all the time that could be easily prevented (the water stations rn are made of plastic (PVC), which leaches in the water over time and leads to nanoplastics accumulating in all of us. Easily prevented through more expensive steel pipes). Hell, my office had asbestos in the ceiling that was painted over! It sucks we lack regulation, as I do not believe it is my job to check these things and report them, and I got tired of it. Given the EPA is lacking funds, it is imperative all of us do due diligence so our children do not experience the cancer rates that are ravaging us (our cancer rates are 30% higher than Europe once you rule out lung cancer, which is a result of their smoking habits. The europeans love their cigs).
- LorenPechtel 2y agoSteel pipes? You realize steel that can be made into a pipe contains some metals you want to minimize your exposure to? As for painting over asbestos--that's actually considered acceptable. Asbestos sitting there isn't going to hurt you. Asbestos only hurts you when it's disturbed. Removing intact asbestos is likely to increase your exposure, not decrease it. As for cancer--why are you so sure it's chemicals and not lifestyle?
- MPSFounder 2y agoI cannot be sure. Causation is very difficult to pinpoint. Not all steel leaches (hell, we use stainless steel cups often). I will take steel over plastics any given day of the week. Regarding paint, sure, but paint peels, and next you are breathing microdoses of asbestos.
- eru 2y agoThey would have probably been better off without a water filter? Your local utility should send you water that doesn't need further filtering.
- evil-olive 2y ago> but I also think the extreme results from this study aren't going to hold up to further research. there already is further research. and the results do seem to be holding up. the study you're quoting from is the one linked in the 2nd paragraph of the article. this is from the 3rd paragraph: > But it’s consistent with a growing literature on the cognitive impact of air pollution, which finds that everyone from chess players to baseball umpires to workers in a pear-packing factory suffer deteriorations in performance when the air is more polluted. that paragraph links to an earlier Vox article [0] which goes into more detail, and well as linking to all of the various studies: > A wide range of studies about the impact of pollution on cognitive functioning have been published in recent years, showing impacts across a strikingly wide range of endeavors. Stripe CEO Patrick Collison has taken an interest in this subject and compiled much of the key research on his personal blog. Among the findings he’s highlighted include: > - Exposure to fine particulates over the long term leads to increased incidences of dementia and Alzheimer’s disease in the elderly (a second study confirms this). > - A study of 20,000 older women found that 10 micrograms of additional long-term particulate exposure is equivalent, across the board, to about two additional years of aging. > - The impacts are not limited to the elderly, however, nor are they exclusively long-term. A range of specialized professionals also seem to suffer short-term impairment due to air pollution. Skilled chess players, for example, make more mistakes on more polluted days. Baseball umpires are also more likely to make erroneous calls on days with poor air quality. Politicians’ statements become less verbally complex on high-pollution days, too. > - Ordinary office workers also exhibit these impacts, showing higher scores on cognitive tests when working in low-pollution ( or “green”) office environments. Individual stock traders become less productive on high-pollution days. > - The same also appears to be true for blue collar work. A study of a pear-packing factory found that higher levels of outdoor particulate pollution “leads to a statistically and economically significant decrease in packing speeds inside the factory, with effects arising at levels well below current air quality standards.” > - Last but by no means least, the cognitive impacts appear to be present in children, with a Georgia study that looked at retrofits of school buses showing large increases in English test scores and smaller ones in math driven by reduced exposure to diesel emissions. 0: https://www.vox.com/future-perfect/2019/12/11/20996968/air-pollution-cognitive-impact https://www.vox.com/future-perfect/2019/12/11/20996968/air-p...
- fasthands9 2y agoIt also seems possible that students do better on tests when the air is cleaner, but that doesn't necessarily mean the students learned more. Imagine if some schools installed air conditioning in their gym one year. Running times around an indoor track would improve considerably, but mostly because conditions at the point of testing improved. Not necessarily because the air conditioning made the students actually improve their stamina or speed.
- ninetyninenine 2y agoYou ever heard of the paradox of IQ? IQ has about a 0.2 correlation with income. The paradox arises when you zoom out for a more macro view. National IQ has about a 0.6-0.8 correlation with GDP per capita. Performance in class rooms is definitely an IQ thing and different view points will likely generate different sets of data. I'm interested in seeing controlled trials on individual performance, not just observing real world scenarios.
- d--b 2y agoMaybe or maybe not. Further research should tell. Maybe the tests results are better because the children are more rested on the day of the test. Maybe the hum of the machine creates some kind of meditative noise that helps children concentrate. Or maybe none of that is true..
- facile3232 2y ago> but expecting test scores to improve dramatically like this is not realistic That seems like a problem for the reader, not a problem with the text. Why would the reader expect this? Is it the use of present tense in the title rather than past tense?
- Aurornis 2y agoWhat do you mean? The article implies it from the title through the text. They hedge by saying “could” but like most articles in this vein it goes on to pivot around the outlier study.
- facile3232 2y agoAh! I just skipped the article. The paper is much more straightforward.
- AngryData 2y agoI would also think there is a bias of schools spending extra money and effort towards student improvements if they are willing to go so far as allocate funding for air filtration systems. A better method would be to just give some schools air filtration for free and see if things help without any other major changes. To me its like looking at schools that buy newer buses and trying to show new buses improve test scores. When in practice the only schools that are buying any significant number of new buses have far more money coming in than in the past and have a lot more to spend on students compared to other schools, which is way more relevant than what year a kid's bus is made. Maybe better buses would improve scores too, but there is no way to tell if 95% of an improvement is due to other unrelated factors based on funding.
- Aurornis 2y ago> A better method would be to just give some schools air filtration for free and see if things help without any other major changes. This is what the study looked at. The problem was that it wasn’t randomized within schools or across teachers. They also looked at a very limited time window. They also note that some teachers weren’t using the air filters. They also found that the VOCs they were trying to filter weren’t even detected before the filters were used. They also used some questionable regressions to imply larger trends. The list of problems goes on and on. It’s fascinating how easily people are tricked into pivoting around this one study, though, simply because it’s the one introduced by the headline.
- jancsika 2y ago> They also looked at a very limited time window. They also note that some teachers weren’t using the air filters. To correct and clarify: They also looked at a very limited time window. They also note that-- after this very limited time window-- some teachers stopped using the air filters. In the words of the authors, this made long-run results "difficult to interpret."
- stdbrouw 2y agoI would also expect the estimated magnitude of the effect to go down over time, but that's just my general attitude to these kinds of things, the fact is that the discontinuity design that they use already accounts for variations between classes, teachers, schools, years. The way it works is that some unexpected event that applies to some people but not others is taken to represent a natural experiment, and then variation between groups before the event is compared to variation between groups after the event. The comparison is never against no variation. The smoking gun is really in Table 3 and Table 4, where you can see that the effects that were observed are compatible with a population effect of 0, or alternatively you can look at Figure 2 and note that you could draw a straight line (no effect) within the confidence bands. Doesn't mean the effect is not there, but that there's insufficient evidence that it is, and that we should indeed be very careful about taking the estimates at face value.
- dzhiurgis 2y agoPerhaps we shouldn’t need a large cohort study to give little humans the right to breathe as good as battery chickens.