7 ms·
Stay-at-home policy is a case of exception fallacy
- mgalgs 6y ago> 11 March 2021 Editor’s Note: Readers are alerted that the conclusions of this article are subject to criticisms that are being considered by the Editors. A further editorial response will follow once all parties have been given an opportunity to respond in full.
- GenerocUsername 6y agoWhen the science doesn't match your preconceived notions
- 542458 6y agoYou don’t know that was the issue. There may be other (more or equally valid) scientific data that contradicts the article, or there may be flaws in the analysis. Looking at the article, is about a computer model that somebody built - these are incredibly easy to (intentionally or unintentionally) bias, and I’d say that looking at this critically is entirely appropriate.
- igorstellar 6y agoArticle like this takes months to put in. It takes one minute to put this disclaimer basically cancelling the article with "but we will tell you why we're cancelling it later".
- goalieca 6y agoTrained scientists are capable of reading any article with a healthy dose of skepticism and does not need to be reminded of this for any paper. All papers have limitations and just because it is published even in a prestigious journal does not make it true. I think this notice exists for the casual reader and reporter and I also doubt the message would have been posted if it did not counter public policy.
- nthot 6y agoReading through the abstract it immediately doesn’t appear that they are using the correct statistical test to come to the conclusion they are claiming. Like another comment says, it takes minutes to criticize what takes months to make, so I’ll read through the article and work through how they came to their methodology before saying more.
- anotheryou 6y agoI wonder if policies are the best measurement. Why not take e.g. the google movement data directly? I had a look at the german numbers and often the public reacted before the policy. Similarly they might subvert policies if they disagree, different cultures certainly got together in different ways, ect. On the other hand I had a look at the "stringency index" of ourworldindata and found it doesn't represent all the little more or less compromising compromises in the policies very well.
- ghaff 6y agoYes, official policies seem a fairly poor proxy for how people have actually acted. This is an interesting site with respect to mobility (in the US). https://covid19.gleamproject.org/mobility https://covid19.gleamproject.org/mobility I played around with it a bit and you can certainly pick and choose cases where less mobility seemed to correspond to better outcomes. But you can also find other cases where less or more mobility didn't seem to lead to especially different outcomes.
- seniorsassycat 6y agoI haven't finished the paper the the abstract reads as if the authors used mobility data, not official policy, to measure stay at home. > In this ecological study, data from www.google.com/covid19/mobility/, ourworldindata.org and covid.saude.gov.br were combined. Countries with > 100 deaths and with a Healthcare Access and Quality Index of ≥ 67 were included. Data were preprocessed and analyzed using the difference between number of deaths/million between 2 regions and the difference between the percentage of staying at home.
- anotheryou 6y agothanks!
- simonbarker87 6y agoRegardless of weather stay at home orders worked for COVID I can tell you one delightful side effect. The last time I was ill of any description was late Feb 2020, I had the worst cold/flu of my life that lasted 3 weeks, I’ve had nary a sniffle since. Usually I have 6/7 colds per year (summer and winter) but in the last 12 months - nothing. Seems very likely that is down to not seeing people, wearing a mask, washing hands etc.
- chrischen 6y agoDo you think it’s possible that normalization may cause a surge of new illnesses due to lack of normally developed immunities?
- pessimizer 6y agoIf fewer people caught colds/flus, maybe there are fewer mutations that resulted? It isn't as if flu/colds were having their normal spreads somewhere, and after quarantine the doors between former-quarantineland and normal-land will be thrown open, releasing a year of backlog.
- ceejayoz 6y agoIf immune systems forgot everything that quickly, vaccines wouldn’t work. None of us are living in hermetically sealed clean rooms, either.
- sitharus 6y ago> Countries with > 100 deaths and with a Healthcare Access and Quality Index of ≥ 67 were included So this excludes New Zealand. I think that’s an important point, as due to strict lockdowns we’ve had at least six months with no restrictions on movement at all, except through the border. We’ve had three community outbreaks and each time lockdowns combined with contact tracing have stopped the spread. I’m no epidemiologist so have no clue if there’s other factors in play, but I appreciate having cafes and offices open.
- rossdavidh 6y agoLots of New Zealand's neighbors are orders of magnitude less than Europe and the Americas, also, so it's not clear what to make of that. However, I think the rationale for using only countries with > 100 deaths would be that it's not looking at how to prevent things from starting, but rather what strategies are effective once they've already gotten seriously going (which was already the situation for many countries a year ago).
- sitharus 6y agoNew Zealand did have serious local spread last March, our R value was over 2. We’ve never been able to completely prevent Covid-19 outbreaks.
- tsimionescu 6y agoIt also excludes Vietnam, a country with 100M bordering China, with the first evidence of community spread outside of China, which has experienced a total of 35 deaths so far in the pandemic. They also credit their success to effective lockdowns and contact tracing (tracing up to 3 degrees of connection, so typically putting more than 100 people in isolation for every case identified). Edit: fixed geographical mistake :).
- jandrewrogers 6y agoFWIW, by all accounts (I have family there), COVID is endemic in Viet Nam but simply isn't reported. Lots of elderly people were seriously ill with unusual "pneumonia" but the government doesn't test them. The sick people with likely COVID were being turned away from the hospitals, so many traveled to their family homes in the countryside. COVID doesn't exist because they refuse to measure it. Which is about what you'd expect there.
- rossdavidh 6y agoI have come to the conclusion that a rational, scientifically sound analysis of things like mask-wearing, social distancing, stay-at-home, closing schools, WFH, etc. is all going to have to occur a few years from now, when tempers have cooled. The initial analysis of any complex system is virtually certain to be riddled with errors, even when it is something like the growth patterns of crab claws in the southern hemisphere, about which few people have strong emotions. Little has been demonstrated to my satisfaction so far in this pandemic, except for these two things: 1) the vaccines appear to work (whew) 2) we aren't really able, as a society, to think clearly about a pandemic while it's happening
- smitty1e 6y ago> a few years from now, when tempers have cooled. The initial analysis of any complex system is virtually certain to be riddled with errors Society does not seem to be on a good course at the moment. The new Authoritarian chic may delay rational dialogue by several centuries until the Dark Age has passed.
- hellbannedguy 6y agoMy hope is that social distancing continues—not at concerts, etc., but places we are forced to go, like grocery stores, etc. I’ve even gotten used to the mask, but feel that will be a welcomed good riddance by most. I had one cold this winter, rather than counting on get sick 4-5 times. I do have a self-centered concern on opening up though. My life was lousy before the epidemic. I didn’t see a great economy. I saw a lot of really lousy jobs, and a lot of desperate competition. I noticed some societal pressure to produce/succeed lighten up during the pandemic, at least for myself. In a weird way, it was kind of a positive. With each day they are counting to opening up, I noticed my sleep, and depression worsen.
- godfreyantonell 6y agowhere do you live?
- sokoloff 6y agoI hope that social distancing entirely disappears, leaving us only with an increased acceptance of working from home and a dramatic increase in the unacceptability of going to the office when sick. In the future, I don’t want to act as if all my fellow humans might have cooties, as I think that’s more damaging than the slight increase in viral infections.
- dariosalvi78 6y agothe fact that stay at home does not explain differences in death rates does not exclude that reduction of contacts (at work, social life etc.) doesn't explain it either. In other words, it may be enough to just "avoid people" a bit more than usual to bring down infections, instead of self-isolating at home.
- ghaff 6y agoMy (deep blue) state has never had real "stay at home"/lockdown orders. But indoor dining/bars were shut down, many/most offices were closed, people were masking (at least indoors), distancing, mostly not going to stores more than necessary, etc. So just because people weren't in "lockdown" behavior was nothing like normal.
- mortehu 6y agoYes, even NYC didn't force people to stay inside, but drastically expanded outdoor dining, closed down streets in neighborhoods without parks so people can walk outside, and has kept playgrounds open since June 22nd.
- ineedasername 6y agoIt is difficult to measure something like this based on policies alone, when attitudes towards policies and therefore compliance varies significantly, as do things like population density and more. If you want to see the impact that stay-at-home has had on COVID, a good place to start is looking at the prevalence of the Flu, for which was have years of baseline #s to compare to 2020, and Winter 2020 has seen the Flu practically disappear. This is of course not conclusive evidence, but it definitely shows that stay-at-home can be massively effective at preventing disease transmission.
- yardie 6y agoI was just talking to a stranger about this yesterday, COVID has suppressed flu cases in the US significantly. Since we live in a state with a soft lockdown COVID policy, Florida, our theory is it has a lot to do with masks, sanitizers, increased public/commercial cleaning, and people staying the fuck home if they have mild flu-like symptoms. And that last bit is important because I knew far too many people dragging themselves into work with a runny nose and fever and basically spreading illnesses to anyone they come in contact with. After the vaccine has reached herd immunity levels I hope there are real lessons learned about containing highly contagious diseases.
- ghaff 6y agoThe sanitizers and cleaning part certainly didn't hurt. And people continue to go through the motions but it seems increasingly the view that it really didn't matter much, especially to the point where people were sanitizing all their grocery purchases or leaving their Amazon deliveries in the garage for 3 days. I was at an event just over a year ago where we weren't handshaking and surfaces were being wiped down but otherwise we were taking zero precautions which was pretty much the norm at the time. So, basically, we weren't taking any meaningful precautions.
- mdoms 6y agoI live in New Zealand, where our first lockdown was taken VERY seriously by nearly everyone. If the population actually does it, lockdown works. A lot of people credited our current administration for our successful Covid elimination, but I think it comes down to our culture. We work together in close communities.
- raverbashing 6y agoThere are too many variables, and it seems to me the main issue is comparing cities between themselves (where there are several variables more to consider) than each city with itself, which presents problems as well > Pubs, restaurants, and barbershops were open in Ireland on June 29th and masks were not mandatory, after more than 2 months, no spike was observed; indeed, death rates kept falling. It's obvious there's a gigantic seasonality effect in Covid. Whereas Ireland reopened in December and the cases shot up. Only some pubs were reopened during that time in Ireland (with limitations, distancing, etc) and you can bet most people kept their masks in barbershops.
- fortran77 6y agoI thought what drove the stay-at-home policy was the fear that Hospitals would exceed capacity. So the only realistic solution is a shutdown for everyone. It would be impractical to enforce in a free society and widely perceived as "unfair" to only have a stay-at-home for high-risk individuals.
- jhayward 6y agoIt' not impossible because of some feelings, it's impossible because there is no way to effectively protect the aged, immune-suppressed, and those with pre-existing risk factors. They live in a society. If that society is letting the virus run rampant, they will be exposed. This has been demonstrated many times and we don't need any more naive assertions about 'just stay at home if you are scared'.
- deleted 6y ago[deleted]
- RazTeve 6y agoStay-at-home policy has unintended consequences that should be studied with similar scrutiny. "Virus going to virus" is too true, the economic and mental health impact from the fear-mongering and death counting is largely understated. We have a long way to go from here, but I'm hopeful that governments move their focus to providing solid data with information about collection methodology to keep the public informed. All the central planning and ruling with the threat of being thrown in a cage as a penalty is too exhausting.
- cornel_io 6y agoI did not read this in detail (I did read it, but I didn't work out the math, etc, which is what a proper commentary would require), but it's worth pointing out that it's extremely easy to set up an analysis in a way that makes it highly unlikely that you'll achieve statistical significance, whether accidentally or on purpose or some combination of the two. Typically there's zero incentive for a researcher to do so, since nobody publishes "we failed to reject the null hypothesis" as a breakthrough result, but it's a really common mistake. Smooth out one too many variables, bucket broadly, do too many pointless comparisons and let the Bonferroni correction push your significance threshold to the moon, etc. It's arguably easier to slip into accidental insignificance than to p-hack or any of the other well known stats shenanigans that make most observational studies worthless. This is the kind of result where I do worry a lot about that, since it is one of a very few topics where a null result might still be newsworthy, and where the result grossly defies common sense (if people are really staying home, pretty much any model of disease spread would predict less spread).
- 13415 6y ago> if people are really staying home, pretty much any model of disease spread would predict less spread That's the point I've also mentioned in a post. If an applied statistics paper yields results that directly contradict good analytical causal models, then you know something is wrong with it. But I was heavily downvoted for that and deleted my post. I believe there are trolls or bots in this thread on HN today.
- georgewfraser 6y agoThe entire category of "is X associated with COVID" research is a recipe for p-hacking, because you're looking at relationships between slowly changing variables, with all sorts of confounds, and there are so many ways to do multiple regression/synthetic controls/and so on. It ends up telling you as much about the priors of the researchers as anything else. My favorite example of this is the research group that found that the Sturgis motorcycle rally increased COVID: https://onlinelibrary.wiley.com/doi/full/10.1002/soej.12475 https://onlinelibrary.wiley.com/doi/full/10.1002/soej.12475 But the same research group found that BLM protests did not: https://www.nber.org/papers/w27408 https://www.nber.org/papers/w27408 It's possible that both are true, but it's a bit suspicious that these findings are so well-aligned with the probable political associations of the authors.
- Uehreka 6y agoDisclaimer: I probably share a lot of those political leanings. With that said... My understanding was that there were a lot of “mask-skeptic” folks at the Sturgis Motorcycle Rally openly flaunting safety protocols and doing stuff like hanging out in packed bars with no mask on. Sure, you can get away with some amount of line-stepping and even straight up rule-breaking and still not catch Covid, but when you have a gathering of people for whom flaunting Covid restrictions is actually a form of virtue-signalling... well it’s probably not going to end great. Having attended the BLM protests myself (in Baltimore), I don’t think I saw a single person not wearing a mask. I’m sure they existed somewhere in America, but I’m pretty sure if you showed up without a mask someone would give you a disposable one. Why do I think that? Because there were also folks with hand sanitizer pumps giving away hand sanitizer for free. The walking marches were not perfectly socially distanced, but with everyone wearing masks and walking about 3ft apart in the open air, it makes sense that there would’ve been less spread. There were also marches that were done as parades of cars so that folks who were more at-risk for Covid had a safer way to participate. Again, good intent alone won’t stop the spread of a disease (it doesn’t care if you’re “trying real hard” to be safe). But when the culture of a group is focused around taking the virus seriously and trying to balance the goals of the movement with keeping people safe, it makes sense that you’ll have better outcomes.
- 6y ago
- goatinaboat 6y agoThe factors in COVID are age and obesity, countries with older and/or fatter populations have more cases per capita and hence deaths. Lockdown is a rounding error.
- boldpandabear 6y agoI love how all the “rational” “analytical” “science-trusting” commenters in her choose to ignore data and “science” when it doesn’t fit their beliefs. The article clearly states “ With our results, we were not able to explain if COVID-19 mortality is reduced by staying at home in ~ 98% of the comparisons after epidemiological weeks 9 to 34.” And everyone’s conclusion in Hacker News is that the study must be flawed.
- ceejayoz 6y agoYou apparently don’t believe viruses exist, so maybe sit this one out? https://news.ycombinator.com/item?id=26461410 https://news.ycombinator.com/item?id=26461410
- boldpandabear 6y agoParticles exist, yes. A few scientists have spun the narrative that transmissible particles CAUSE illness. That is not proven. Scientists harp on the fact that correlation and association, do not mean causation. Except in virology where circumstantial evidence is enough to upend the freedom of the world for the sake of an abundance of caution. This religion of virology.
- TeeMassive 6y agoEven at the first months the WHO said that lock-downs were last resort measures and that aggressive contact tracing and testing was the only practical solution before vaccines and effective treatments were found. It was also known early that at home transmissions formed the vast majority of transmissions and that Vitamin D and zinc deficiencies were determinant for complication and mortality rates. It is clear by now that stay-at-home orders are maintained or ended for political reasons.