49 ms·
I have wondered about the selection bias issue, and I was hopeful that this writeup would give a good look at this and other potential issues with the study. B
by gnicholas 7y ago
I have wondered about the selection bias issue, and I was hopeful that this writeup would give a good look at this and other potential issues with the study.
But when I read it, I was a bit turned off by the author's attitude — which seems to be that he or some of his colleagues should have been consulted by the study authors because they are "statistics experts".
He refers to this apparent omission multiple times, and he also seems to think he's dunking on the authors when he references Theranos (and the fact that its advisors came from government/law/military). But this study is completely unrelated to Theranos (though they both involve blood and Stanford). Off-topic comments like these left me wondering if his analysis is a fair critique, or if he has an axe to grind.
- jxramos 7y agocould be the drop of blood intersection more than the generic subject of blood.
- paultopia 7y agoBut he's right though---the authors should have consulted some survey data experts. And the other people he names are, in fact, well-known survey data experts who could have made the work better.
- buboard 7y agothe authors list had plenty of epidemiology data experts
- ineedasername 7y agoThat is not the same as survey experts.
- SpicyLemonZest 7y agoThere's always going to be some subcategory of experts they didn't talk to. Do medical studies typically include survey experts signing off on the surveys?
- ineedasername 7y agoWhen a survey is a critical aspect of your study & data gathering, then yes: consultation with someone familiar with best practices in survey design is pretty common.
- buboard 7y agosurveillance is an expertise of epidemiologists though.
- and-hi 7y agoThe author, Andrew Gelman, is one of the best statisticians of our times. And his criticism that they should have consulted an expert seems fair, since this blog post clearly shows that the study did not give strong evidence for a high prevalence of Covid-19. It might have all been false positives. The off-topic comments make more sense when one has read the blog for a longer time. The author has criticized so many studies over the years that he must feel a bit of frustration by now. I guess the hacker news crowd wasn't the intended audience for such comments.