6 ms·

If you look at test results you probably won’t learn much. There will be far fewer tests than cases and most cases will never be tested. It seems more likely th

If you look at test results you probably won’t learn much. There will be far fewer tests than cases and most cases will never be tested. It seems more likely that you’ll just be measuring some other effect of how testing is done, for example if the number of tests per day ramps up slowly (and non exponentially) then it seems likely that you will observe Rt to be decreasing (as the number of confirmed cases isn’t shooting up), especially if people are mostly only tested when they turn up in hospital and are expected to be positive. I don’t know how much the author’s model accounts for that but I find the confidence intervals very unconvincing. I would expect them to be much larger. This study tries to estimate Rt in several European countries from the death rates though there are issues with those statistics too: https://imperialcollegelondon.github.io/covid19estimates/ https://imperialcollegelondon.github.io/covid19estimates/

ulfw 7y ago
You're spot on. Kevin's idea and graphs are nice but they rely on a flawed hypothesis, namely that all states test the same way, taste the same amount per capita etc. They don't. So our graphs can only be as good as the numbers we put in and testing is still very insufficient.
henrikschroder 7y ago
I saw an interesting alternate statistics where you measure the overall mortality rate and compare to previous years. EU only, but something like this might exist elsewhere as well: http://euromomo.eu/ http://euromomo.eu/ The data lags behind a bit, but since it measures total number of deaths, it doesn't matter if different countries measure coronoa-related deaths differently. Everyone measures actual deaths. The numbers are hard to fudge for politicians who wants to boost their results. As a bonus, this also measures how your society is handling the pandemic overall. We know that people will die of the lockdowns as a second-order or third-order effect, and this way we can measure that as well.
- OscarCunningham 7y ago
  The lockdowns will also reduce deaths from other contagious diseases and accidents, particularly car crashes.
  - bodyfour 7y ago
    Yes.. although excess mortality is the thing that we'll look at in retrospect to gauge the overall human cost of this disease, I don't think it is all that useful for measuring "how well is containment working" in real time. Too many confounding factors (both positive and negative) as you mention. Personally I think the best metric is one of the simplest -- the raw percentage of positive tests. This is because it simultaneously captures two important factors: if the percentage is high it means that either you are finding the virus all over the place OR it means your testing capacity is so low that you only are testing highly probably cases. If either of these are true, you should not think about reopening.
    - watwut 7y ago
      There is also category of people who did not died of corona, but would not died had there been no corona epidemic. Hospital being overflown means that many people are not getting same care as they would had there been ventilators, drugs and doctors available.
      - ken 7y ago
        Curiously, hospitals have seen a stark drop in heart attacks, strokes, and other common issues, so this may not actually be a very large number. https://www.nytimes.com/2020/04/06/well/live/coronavirus-doctors-hospitals-emergency-care-heart-attack-stroke.html https://www.nytimes.com/2020/04/06/well/live/coronavirus-doc...
- xorfish 7y ago
  Best data is excess mortality. Many deaths won't be attributed to covid19 but still caused by it. Here an explanation: https://twitter.com/firefoxx66/status/1249996541424816128 https://twitter.com/firefoxx66/status/1249996541424816128
  - SpicyLemonZest 7y ago
    Excess mortality strikes me as very poor data. It seems very unlikely that, during a once-in-a-century pandemic with completely unprecedented severe lockdowns, we should expect all-cause mortality to be close to the baseline.
    - xorfish 7y ago
      That is not what we see. Mortality for 65+ is way above the baseline because of covid19.
      - SpicyLemonZest 7y ago
        Sorry, what isn't what we see? I don't think there's a reasonable baseline at all; I think we have no idea what mortality "should" look like, in a world where everyone's under house arrest and afraid of hospitals. You can argue it's lower because people are taking less risks, higher because they're under more stress, lower because they're eating out less, higher because they don't get hospital treatment they need.
- andruby 7y ago
  Belgium has this specifically for our country [0]. It has a 4 week lag, but they've started to include interim data in the weekly updates by the national bureau for epidemics. The last weekly update included the "excess deaths" compared to previous years: [1] Week Monday Observed Expected % Deaths Deaths Deaths Excess Per 100K 2020-W11 09/03/2020 2,220 2,302 -3.6 19.4 2020-W12 16/03/2020 2,531 2,275 11.3 22.1 2020-W13 23/03/2020 3,116 2,249 38.5 27.3 In other words: in the last week of March, we had 38.5% more deaths than usual. Or 7 extra deaths per 100K inhabitants. That's terrifying. Side note: Belgium is one of the only countries that includes deaths in carehomes and at home. The deaths in carehomes is almost half of all covid-19 deaths here. [0] https://epistat.wiv-isp.be/momo/ https://epistat.wiv-isp.be/momo/ [1] https://epidemio.wiv-isp.be/ID/Documents/Covid19/COVID-19_Daily%20report_20200409%20-%20NL.pdf https://epidemio.wiv-isp.be/ID/Documents/Covid19/COVID-19_Da... (NL or FR only, sorry)
- alkonaut 7y ago
  How do you interpret a zero negative excess death rate? Sweden has over 1000 Covid attributed deaths, but almost no difference in weekly deaths compared to the same weeks in 2019. Death numbers are extremely noisy and especially in the flu season with the flu one year perhaps twice as deadly as the previous year. Covid restrictions have also reduced (a lot) some other seasonal diseases like flu and noro/caliciviruses, so you get an effect in the other direction too. When those that die from Covid are in the highest age groups it's not unthinkable that a part of them would have been killed by the flu too, only the flu didn't come this year because of Covid. Perhaps that's why we have a lot Covid deaths but no excess deaths? Who knows. It's too noisy and has too many dependencies to be very useful I think.
  - malkuth23 7y ago
    Less people driving?
    - alkonaut 7y ago
      Didn't think about that. Looking at figures it's less than 6/week killed in traffic, while all deaths is 1700/week, so it's unlikely to make a dent. Easter is probably one of the worst traffic weeks, but even then it's probably not enough for a difference.
    - throw_away 7y ago
      Also perhaps fewer elective medical operations, which result in fewer iatrogenic deaths (3rd leading cause of death, at least in the US).
      - alkonaut 7y ago
        This is a good candidate. Although some of this effect might be countered by people dying because they didn't get elective treatment. Regardless: when you change pretty much every parameter of society (risk behavior, driving, crime, health care, ...) I don't understand how one can use the overall death statistics and try to attribute them to Covid.
angled 7y ago
A GP in Hong Kong is attempting to study this across 1000 people, which is only marginally fewer than the number of cases in Hong Kong as of today (1013 confirmed cases): https://www.otandp.com/blog/estimating-the-longitudinal-seroprevalence-of-covid-19-in-hong-kong https://www.otandp.com/blog/estimating-the-longitudinal-sero... Hong Kong government is also measuring the real time effective reproduction number: https://chp-dashboard.geodata.gov.hk/covid-19/en.html https://chp-dashboard.geodata.gov.hk/covid-19/en.html (click on the arrows at the bottom to scroll left and right through various dashboards)
- bodyfour 7y ago
  That HK government website is amazing.
alkonaut 7y ago
> This study tries to estimate Rt in several European countries from the death rates though there are issues with those statistics too: https://imperialcollegelondon.github.io/covid19estimates/ https://imperialcollegelondon.github.io/covid19estimates/ Most obviously that report used the reporting date of deaths as the death date, even though actual death date data was available. The results are dramatically different because of it.

ulfw 7y ago

You're spot on. Kevin's idea and graphs are nice but they rely on a flawed hypothesis, namely that all states test the same way, taste the same amount per capita etc. They don't. So our graphs can only be as good as the numbers we put in and testing is still very insufficient.

henrikschroder 7y ago

I saw an interesting alternate statistics where you measure the overall mortality rate and compare to previous years. EU only, but something like this might exist elsewhere as well: http://euromomo.eu/ http://euromomo.eu/ The data lags behind a bit, but since it measures total number of deaths, it doesn't matter if different countries measure coronoa-related deaths differently. Everyone measures actual deaths. The numbers are hard to fudge for politicians who wants to boost their results. As a bonus, this also measures how your society is handling the pandemic overall. We know that people will die of the lockdowns as a second-order or third-order effect, and this way we can measure that as well.

OscarCunningham 7y ago
The lockdowns will also reduce deaths from other contagious diseases and accidents, particularly car crashes.
- bodyfour 7y ago
  Yes.. although excess mortality is the thing that we'll look at in retrospect to gauge the overall human cost of this disease, I don't think it is all that useful for measuring "how well is containment working" in real time. Too many confounding factors (both positive and negative) as you mention. Personally I think the best metric is one of the simplest -- the raw percentage of positive tests. This is because it simultaneously captures two important factors: if the percentage is high it means that either you are finding the virus all over the place OR it means your testing capacity is so low that you only are testing highly probably cases. If either of these are true, you should not think about reopening.
  - watwut 7y ago
    There is also category of people who did not died of corona, but would not died had there been no corona epidemic. Hospital being overflown means that many people are not getting same care as they would had there been ventilators, drugs and doctors available.
    - ken 7y ago
      Curiously, hospitals have seen a stark drop in heart attacks, strokes, and other common issues, so this may not actually be a very large number. https://www.nytimes.com/2020/04/06/well/live/coronavirus-doctors-hospitals-emergency-care-heart-attack-stroke.html https://www.nytimes.com/2020/04/06/well/live/coronavirus-doc...
xorfish 7y ago
Best data is excess mortality. Many deaths won't be attributed to covid19 but still caused by it. Here an explanation: https://twitter.com/firefoxx66/status/1249996541424816128 https://twitter.com/firefoxx66/status/1249996541424816128
- SpicyLemonZest 7y ago
  Excess mortality strikes me as very poor data. It seems very unlikely that, during a once-in-a-century pandemic with completely unprecedented severe lockdowns, we should expect all-cause mortality to be close to the baseline.
  - xorfish 7y ago
    That is not what we see. Mortality for 65+ is way above the baseline because of covid19.
    - SpicyLemonZest 7y ago
      Sorry, what isn't what we see? I don't think there's a reasonable baseline at all; I think we have no idea what mortality "should" look like, in a world where everyone's under house arrest and afraid of hospitals. You can argue it's lower because people are taking less risks, higher because they're under more stress, lower because they're eating out less, higher because they don't get hospital treatment they need.
andruby 7y ago
Belgium has this specifically for our country [0]. It has a 4 week lag, but they've started to include interim data in the weekly updates by the national bureau for epidemics. The last weekly update included the "excess deaths" compared to previous years: [1] Week Monday Observed Expected % Deaths Deaths Deaths Excess Per 100K 2020-W11 09/03/2020 2,220 2,302 -3.6 19.4 2020-W12 16/03/2020 2,531 2,275 11.3 22.1 2020-W13 23/03/2020 3,116 2,249 38.5 27.3 In other words: in the last week of March, we had 38.5% more deaths than usual. Or 7 extra deaths per 100K inhabitants. That's terrifying. Side note: Belgium is one of the only countries that includes deaths in carehomes and at home. The deaths in carehomes is almost half of all covid-19 deaths here. [0] https://epistat.wiv-isp.be/momo/ https://epistat.wiv-isp.be/momo/ [1] https://epidemio.wiv-isp.be/ID/Documents/Covid19/COVID-19_Daily%20report_20200409%20-%20NL.pdf https://epidemio.wiv-isp.be/ID/Documents/Covid19/COVID-19_Da... (NL or FR only, sorry)
alkonaut 7y ago
How do you interpret a zero negative excess death rate? Sweden has over 1000 Covid attributed deaths, but almost no difference in weekly deaths compared to the same weeks in 2019. Death numbers are extremely noisy and especially in the flu season with the flu one year perhaps twice as deadly as the previous year. Covid restrictions have also reduced (a lot) some other seasonal diseases like flu and noro/caliciviruses, so you get an effect in the other direction too. When those that die from Covid are in the highest age groups it's not unthinkable that a part of them would have been killed by the flu too, only the flu didn't come this year because of Covid. Perhaps that's why we have a lot Covid deaths but no excess deaths? Who knows. It's too noisy and has too many dependencies to be very useful I think.
- malkuth23 7y ago
  Less people driving?
  - alkonaut 7y ago
    Didn't think about that. Looking at figures it's less than 6/week killed in traffic, while all deaths is 1700/week, so it's unlikely to make a dent. Easter is probably one of the worst traffic weeks, but even then it's probably not enough for a difference.
  - throw_away 7y ago
    Also perhaps fewer elective medical operations, which result in fewer iatrogenic deaths (3rd leading cause of death, at least in the US).
    - alkonaut 7y ago
      This is a good candidate. Although some of this effect might be countered by people dying because they didn't get elective treatment. Regardless: when you change pretty much every parameter of society (risk behavior, driving, crime, health care, ...) I don't understand how one can use the overall death statistics and try to attribute them to Covid.

angled 7y ago

A GP in Hong Kong is attempting to study this across 1000 people, which is only marginally fewer than the number of cases in Hong Kong as of today (1013 confirmed cases): https://www.otandp.com/blog/estimating-the-longitudinal-seroprevalence-of-covid-19-in-hong-kong https://www.otandp.com/blog/estimating-the-longitudinal-sero... Hong Kong government is also measuring the real time effective reproduction number: https://chp-dashboard.geodata.gov.hk/covid-19/en.html https://chp-dashboard.geodata.gov.hk/covid-19/en.html (click on the arrows at the bottom to scroll left and right through various dashboards)

bodyfour 7y ago
That HK government website is amazing.

alkonaut 7y ago

> This study tries to estimate Rt in several European countries from the death rates though there are issues with those statistics too: https://imperialcollegelondon.github.io/covid19estimates/ https://imperialcollegelondon.github.io/covid19estimates/ Most obviously that report used the reporting date of deaths as the death date, even though actual death date data was available. The results are dramatically different because of it.