Thanks for sharing! It's interesting that even one of the largest still uses manual execution for almost all of their pipelines (at least in the covid data pro

Thanks for sharing! It's interesting that even one of the largest still uses manual execution for almost all of their pipelines (at least in the covid data project[1]). This [2] seems like the bulk of their data importers (scrapers) but most are still operating as manual jobs. I guess with open-source data work, hours and minutes don't matter as much, and being a few days behind the latest data is acceptable. 1 - https://docs.owid.io/projects/covid/en/latest/data-pipeline.html https://docs.owid.io/projects/covid/en/latest/data-pipeline.... 2 - https://github.com/owid/importers https://github.com/owid/importers