3 ms·

I'm curious if there are opportunities to be a force multiplier here. I see that the Readme says "there's no automated scraper farm" yet. Getting that set up se

by bckr 4y ago

I'm curious if there are opportunities to be a force multiplier here. I see that the Readme says "there's no automated scraper farm" yet. Getting that set up seems crucial. Will jump on the Discord :)

kristintynski 4y ago
The community has been writing scrapers since the beginning, but it's a huge task. We've also written scraper templates, since many counties use the same systems. https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers https://github.com/Police-Data-Accessibility-Project/PDAP-Sc...
- bckr 4y ago
  Yep, I see that there are a lot of existing scrapers. Getting those up and running automatically on a backend host will make things a lot smoother. Also, I recommend using Playwright instead of Selenium. I'm in the Discord now and will be hanging out, so looking forward to chatting more about this and contributing.
  - josh-pdap 4y ago
    Thanks for taking a look! DM me on Discord if you'd like to chat about this.