4 ms·

Is there a forum or somewhere web crawlers hang out online? I'd love the learn about more sophisticated projects like this.

• uniqueuid 4y ago
  In github issues of said projects, and at scientific web archival conferences. Although I'd absolutely welcome some sort of channel!
  • smcnally 4y ago
    Topics include Issues and activities across projects. These topics are quite active, e.g. https://github.com/topics/crawling https://github.com/topics/crawling https://github.com/topics/web-scraping https://github.com/topics/web-scraping https://github.com/topics/web-archiving https://github.com/topics/web-archiving