7 ms·
Can be lots of things, there's lots of evidence that data quality is extremely poor right now, but not enough to be able to say accurately what all the data sho
by IkmoIkmo 7y ago
Can be lots of things, there's lots of evidence that data quality is extremely poor right now, but not enough to be able to say accurately what all the data should be.
For example, in the Netherlands, in a blood test about 3% of the population was found to have antibodies, while the number of people confirmed to have corona via tests is at 0.15% of the population. We're looking at a 1:20 confirmed/actual rate.
That tells you testing is way off, about 20x so. The total tests performed is roughly similar to the US by the way, about 1 in 100.
Then there's death rates. The Netherlands currently saw 2 in 10.000 confirmed deaths from corona. This is about double the rate in the US. However if we look at excess deaths compared to a 3-year average for the same period (2017-2019) we see about triple the amount. Apparently 2 in 3 die of corona without it being tested or confirmed. (likely in nursing homes where mortality rates are often around 30% per year, and it's not uncommon for staff to find a patient died in their sleep for example).
And the Netherlands is a small country with high-quality public infrastructure. It's quite likely that it is among the countries with the best record-keeping system, and is among the countries with the highest tests per population, and even here we see massive undercounting of infections and deaths.
It's good to keep looking at the numbers, but only with a huge caveat. I'm actually completely flabbergasted that the media report on infection numbers without ANY mention of a confidence interval, standard deviation or some kind of uncertainty measurement, as well as some basic stats around testing methodologies, in particular when reporting cross-country comparisons. This should be the norm, but instead we just get country comparisons, world maps and graphs displaying wildly inaccurate and limited data (which is absolutely useful, but criminal to report without caveats). Apart from a mention about 'Chinese data isn't reliable' or 'India isn't testing much, so the problem may be far greater', there's really no consistent discussion about this. There's lots of standard statistical tools to express uncertainty which have been used in science for decades, but they're completely absent in our reporting or discussions at the moment.
- rovolo 7y agoJust a note on the "3% prevalence of antibodies": we need to consider the false positive rate and selection bias for general population antibody tests as well. A biologist I follow was skeptical about a study showing that 1.5% of Santa Clara had antibodies for SARS-CoV-2. I don't know anything about the study in the Netherlands, but the 20x or 100x undercount ratio is going to be very sensitive to the antibody test specificity. https://twitter.com/CT_Bergstrom/status/1251344851984986118 https://twitter.com/CT_Bergstrom/status/1251344851984986118 https://twitter.com/CT_Bergstrom/status/1251346572656304128 https://twitter.com/CT_Bergstrom/status/1251346572656304128 > In the supplement they say 2 out of 371 + 35 known negative samples tested positive. This means that the 95% confidence interval for the false positive rate is [0.06%, 1.77%]. In their samples from Santa Clara County they had 50 / 3,349 = 1.5% test positive.