25k+ hits/minute here. And that's just the scrapers that doesn't just identify themselves as a browsers. Not sure why you believe massive repeated scraping isn

25k+ hits/minute here. And that's just the scrapers that doesn't just identify themselves as a browsers. Not sure why you believe massive repeated scraping isn't a problem. It's not like there is just one single actor out there, and ignoring robits.txt seems to be the norm nowadays.