4 ms·

The team behind https://covid19japan.com https://covid19japan.com fights with this nonsense every day. We're open ears to improvements, and are playing with way

The team behind https://covid19japan.com https://covid19japan.com fights with this nonsense every day. We're open ears to improvements, and are playing with ways to possibly automate bits. Our GitHub: https://github.com/reustle/covid19japan/ https://github.com/reustle/covid19japan/

robinduckett 7y ago
I wish there was something like this for the UK!
- bshimmin 7y ago
  This isn't quite as pretty but is fairly good: https://www.arcgis.com/apps/opsdashboard/index.html#/f94c3c90da5b4e9f9a0b19484dd4bb14 https://www.arcgis.com/apps/opsdashboard/index.html#/f94c3c9...
  - Angostura 7y ago
    Mobile version: https://www.arcgis.com/apps/opsdashboard/index.html#/ae5dda8f86814ae99dde905d2a9070ae https://www.arcgis.com/apps/opsdashboard/index.html#/ae5dda8...
xrd 7y ago
This is fantastic, terrific way to visualize this information. It's interesting that Hokkaido is red for infections but the growth rate is really slow. Are the distant prefectures less likely to follow guidelines from Tokyo and reporting more honestly?
- panny 7y ago
  >It's interesting that Hokkaido is red for infections but the growth rate is really slow. Hokkaido is about the size of South Carolina and approximate population of 6 million people. ~2.5M of which live in Sapporo. Most of the island is more rural with many tourist destinations. It's a popular destination for Chinese tourists in winter. >Are the distant prefectures less likely to follow guidelines from Tokyo Tokyo was seen as mostly following Hokkaido governor's lead early on. Hokkaido was the first to close schools, etc. >and reporting more honestly? Could HN dwellers stop implying Japan is handling this dishonestly? That is extremely rude coming from the nation whose CDC was angry to accept 14 infected citizens from the only ally nation that would accept their US Diamond Princess cruise ship and provide care for passengers.
  - reustle 7y ago
    > Could HN dwellers stop implying Japan is handling this dishonestly? They are. The incredible rate of test refusal here is keeping the numbers very low.
    - odkamkfn 7y ago
      "Test refusal" is a very bad metric. Almost no countries are testing anyone who suspects they might be infected. A lot of European countries actually have more restrictive guidelines than Japan - Norway won't even test people arriving from COVID-19 hotspots if they only exhibit minor symptoms. In Japan 6-7% of the tests come back positive. This is not at all indicative of too little testing.
    - panny 7y ago
      Really? What is the rate of test refusal Shane Reustle?
      - dang 7y ago
        Please do not cross into personal attack.
        panny 7y ago
        Asking for the "incredible" rate of test refusal is not a personal attack. Calling Japanese stupid is not okay, but you don't warn the person who does it. You warn the person who takes the bait. You then retaliate by warning me only after I call you out on it. Shouting fire in a crowded theater is not free speech. What you are doing here is not protected.
        dang 7y ago
        Nobody called the Japanese stupid. You chose to interpret it that way. Actually, I understand how it could feel that way, and I empathize. But take a look again: https://news.ycombinator.com/item?id=22730110 https://news.ycombinator.com/item?id=22730110. It didn't say that. What it did do was repeat an internet cliché [1] in a lazy way. That made it an unsubstantive comment, and an unsubstantive comment on an inflammatory topic is basically always flamebait (as I pointed out to another user earlier today: https://news.ycombinator.com/item?id=22739350 https://news.ycombinator.com/item?id=22739350). You've unfortunately been posting to HN quite a bit in the flamewar style. Would you please stop doing that? I realize that these topics are sensitive and hit sore spots all too easily. That's one reason the site guidelines include: "Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith." It isn't easy, but it's necessary that we all do it, because otherwise we just end up fighting with each other. Fighting each other feels urgent, but is not interesting, and the purpose of HN is to be an intellectually interesting place on the internet, if possible. This requires that we sort of resist the worst interpretations of each other's words, because they're so often vulnerable to misunderstanding. By the way, in case you're not familiar with so-called Hanlon's Razor [1], it's not primarily about stupidity. It's really a way of saying that most human outcomes are not the result of malice. So in a way, that post was a (weak and unclear) defense of the Japanese institutions and reports that were being discussed above—a way of arguing that they weren't conscious bad action. The word 'stupidity' appears in that proverb partly out of ironic humor which is typical of the internet subculture that produced it, since it's ironic to defend someone against the charge of malice by making the charge of stupidity instead. It's not intended as the deep insult that the word 'stupidity' would imply in many cultural contexts. If you already know this, I apologize. There is an additional level also. The word 'stupidity' in that proverb would not normally be a national or racial slur. It usually refers to the 'stupidity' of large institutions, which tend to produce inefficient or inadequate results even when the individuals who make up the institution are doing their best—or to the 'stupidity' of bureaucratic functionaries, who hacker-type people tend to feel superior to and smarter than. If you look at https://news.ycombinator.com/item?id=22556236 https://news.ycombinator.com/item?id=22556236, you'll see exactly the same argument applied to Spain's Covid-19 response. If anyone is being criticized as stupid in those comments, it's not peoples like the Spanish or the Japanese, it's mid-level government officials everywhere. Whether that's fair or not, we can leave as a separate question. [1] https://en.wikipedia.org/wiki/Hanlon%27s_razor https://en.wikipedia.org/wiki/Hanlon%27s_razor
squaresmile 7y ago
I found tabula or camelot to be pretty good at extracting tables from pdf. I worked on a few JP's gov PDFs and they are not fancy so that's nice. Some light post-processing is still needed but the automation probably will keep working if the PDF format doesn't change (big if of course).
Etheryte 7y ago
Out of curiosity, how would you compare your work with that of Johns Hopkins[1]? Your numbers for Japan seem fairly similar to theirs. [1] https://coronavirus.jhu.edu/map.html https://coronavirus.jhu.edu/map.html
stevenwoo 7y ago
Do yall know if how many deaths were from critical cases, I'm assuming some deaths were determined post mortem from people who did not receive critical care. The UK published numbers showing 50% survival rate for people who had to get admitted to the ICU so a surface reading of the stats on the page might indicated a 5 % survival rate in Japan or no relationship at all depending upon interpretation.
omneity 7y ago
We can help with the automation of data extraction from all those regional websites into a single google sheet and save volunteers’ time. I’d be happy to donate scraping capacity to this project. If this is relevant ping me at omar@ domain from my profile.

robinduckett 7y ago

I wish there was something like this for the UK!

bshimmin 7y ago
This isn't quite as pretty but is fairly good: https://www.arcgis.com/apps/opsdashboard/index.html#/f94c3c90da5b4e9f9a0b19484dd4bb14 https://www.arcgis.com/apps/opsdashboard/index.html#/f94c3c9...
- Angostura 7y ago
  Mobile version: https://www.arcgis.com/apps/opsdashboard/index.html#/ae5dda8f86814ae99dde905d2a9070ae https://www.arcgis.com/apps/opsdashboard/index.html#/ae5dda8...

xrd 7y ago

This is fantastic, terrific way to visualize this information. It's interesting that Hokkaido is red for infections but the growth rate is really slow. Are the distant prefectures less likely to follow guidelines from Tokyo and reporting more honestly?

panny 7y ago
>It's interesting that Hokkaido is red for infections but the growth rate is really slow. Hokkaido is about the size of South Carolina and approximate population of 6 million people. ~2.5M of which live in Sapporo. Most of the island is more rural with many tourist destinations. It's a popular destination for Chinese tourists in winter. >Are the distant prefectures less likely to follow guidelines from Tokyo Tokyo was seen as mostly following Hokkaido governor's lead early on. Hokkaido was the first to close schools, etc. >and reporting more honestly? Could HN dwellers stop implying Japan is handling this dishonestly? That is extremely rude coming from the nation whose CDC was angry to accept 14 infected citizens from the only ally nation that would accept their US Diamond Princess cruise ship and provide care for passengers.
- reustle 7y ago
  > Could HN dwellers stop implying Japan is handling this dishonestly? They are. The incredible rate of test refusal here is keeping the numbers very low.
  - odkamkfn 7y ago
    "Test refusal" is a very bad metric. Almost no countries are testing anyone who suspects they might be infected. A lot of European countries actually have more restrictive guidelines than Japan - Norway won't even test people arriving from COVID-19 hotspots if they only exhibit minor symptoms. In Japan 6-7% of the tests come back positive. This is not at all indicative of too little testing.
  - panny 7y ago
    Really? What is the rate of test refusal Shane Reustle?
    - dang 7y ago
      Please do not cross into personal attack.
      - panny 7y ago
        Asking for the "incredible" rate of test refusal is not a personal attack. Calling Japanese stupid is not okay, but you don't warn the person who does it. You warn the person who takes the bait. You then retaliate by warning me only after I call you out on it. Shouting fire in a crowded theater is not free speech. What you are doing here is not protected.
        dang 7y ago
        Nobody called the Japanese stupid. You chose to interpret it that way. Actually, I understand how it could feel that way, and I empathize. But take a look again: https://news.ycombinator.com/item?id=22730110 https://news.ycombinator.com/item?id=22730110. It didn't say that. What it did do was repeat an internet cliché [1] in a lazy way. That made it an unsubstantive comment, and an unsubstantive comment on an inflammatory topic is basically always flamebait (as I pointed out to another user earlier today: https://news.ycombinator.com/item?id=22739350 https://news.ycombinator.com/item?id=22739350). You've unfortunately been posting to HN quite a bit in the flamewar style. Would you please stop doing that? I realize that these topics are sensitive and hit sore spots all too easily. That's one reason the site guidelines include: "Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith." It isn't easy, but it's necessary that we all do it, because otherwise we just end up fighting with each other. Fighting each other feels urgent, but is not interesting, and the purpose of HN is to be an intellectually interesting place on the internet, if possible. This requires that we sort of resist the worst interpretations of each other's words, because they're so often vulnerable to misunderstanding. By the way, in case you're not familiar with so-called Hanlon's Razor [1], it's not primarily about stupidity. It's really a way of saying that most human outcomes are not the result of malice. So in a way, that post was a (weak and unclear) defense of the Japanese institutions and reports that were being discussed above—a way of arguing that they weren't conscious bad action. The word 'stupidity' appears in that proverb partly out of ironic humor which is typical of the internet subculture that produced it, since it's ironic to defend someone against the charge of malice by making the charge of stupidity instead. It's not intended as the deep insult that the word 'stupidity' would imply in many cultural contexts. If you already know this, I apologize. There is an additional level also. The word 'stupidity' in that proverb would not normally be a national or racial slur. It usually refers to the 'stupidity' of large institutions, which tend to produce inefficient or inadequate results even when the individuals who make up the institution are doing their best—or to the 'stupidity' of bureaucratic functionaries, who hacker-type people tend to feel superior to and smarter than. If you look at https://news.ycombinator.com/item?id=22556236 https://news.ycombinator.com/item?id=22556236, you'll see exactly the same argument applied to Spain's Covid-19 response. If anyone is being criticized as stupid in those comments, it's not peoples like the Spanish or the Japanese, it's mid-level government officials everywhere. Whether that's fair or not, we can leave as a separate question. [1] https://en.wikipedia.org/wiki/Hanlon%27s_razor https://en.wikipedia.org/wiki/Hanlon%27s_razor

squaresmile 7y ago

I found tabula or camelot to be pretty good at extracting tables from pdf. I worked on a few JP's gov PDFs and they are not fancy so that's nice. Some light post-processing is still needed but the automation probably will keep working if the PDF format doesn't change (big if of course).

Etheryte 7y ago

Out of curiosity, how would you compare your work with that of Johns Hopkins[1]? Your numbers for Japan seem fairly similar to theirs. [1] https://coronavirus.jhu.edu/map.html https://coronavirus.jhu.edu/map.html

stevenwoo 7y ago

Do yall know if how many deaths were from critical cases, I'm assuming some deaths were determined post mortem from people who did not receive critical care. The UK published numbers showing 50% survival rate for people who had to get admitted to the ICU so a surface reading of the stats on the page might indicated a 5 % survival rate in Japan or no relationship at all depending upon interpretation.

omneity 7y ago

We can help with the automation of data extraction from all those regional websites into a single google sheet and save volunteers’ time. I’d be happy to donate scraping capacity to this project. If this is relevant ping me at omar@ domain from my profile.