> what I've learned is how little regard for your site your scrapers often have, scraping as aggressively as possible. Often? Based on what data? I find it mu

> what I've learned is how little regard for your site your scrapers often have, scraping as aggressively as possible. Often? Based on what data? I find it much more likely you only often notice aggressive scrapers. That however tells you nothing about the behavior of the average web scraper or web scrapers in general.