Admin of a 5000+ website platform (with customer inventory) here. This the exact kind of thing I've been working so hard to block lately. Since Feb 2021 we've

Admin of a 5000+ website platform (with customer inventory) here. This the exact kind of thing I've been working so hard to block lately. Since Feb 2021 we've seen a substantial increase in scraping of our customers' inventory to the point we now have more bot traffic than human traffic. Annoyingly, only 5-10 requests come from a single IP so we've had to resort to always challenging requests that come from certain ASNs (typically those owned by datacenters). This type of project frustrates me because it knowlingly goes against a site's desired bot action (via robots.txt).