2 ms·
We are using this approach to scrape the COVID-19 data in Switzerland. https://github.com/openZH/covid_19 https://github.com/openZH/covid_19 There is a common
by metaodi 6y ago
We are using this approach to scrape the COVID-19 data in Switzerland.
https://github.com/openZH/covid_19 https://github.com/openZH/covid_19
There is a common runner script and a matrix configuration to run this script for each Swiss canton (see https://github.com/openZH/covid_19/blob/master/.github/workflows/run_scrapers.yml https://github.com/openZH/covid_19/blob/master/.github/workf...).
The scrapers report errors to our slack channel and we even have workflows to deactivate/re-activate a single scraper, since it's common that one fails and we need to fix it (to stop spamming the slack channel with error messages).