3 ms·
Whilst it's not ideal, currently experiencing spammer abuse had lead me down similar paths on one of my web apps. Sadly solutions like this free up time for mor
by mootothemax 16y ago
Whilst it's not ideal, currently experiencing spammer abuse had lead me down similar paths on one of my web apps. Sadly solutions like this free up time for more core functionality - which I'd much rather spend my time developing, considering that abuse prevention is not a feature you can charge for exactly.
- bambax 16y agoYes, I understand that, and scrapers certainly are a big pain; but shouldn't SO extend a little more effort to avoid false positives...?
- bxr 16y agoIt seems possible for them to set up the block as a response to request rate/patterns, but as I am unfamiliar with EC2 I have to ask: how hard is it to get a new IP address? If it a matter of stopping an instance and starting another (or easier), blocking all of EC2 may be their only move. Once the scraper isn't tied to a single IP, I don't see how to filter out abusive requests from the legitimate ones. It will cause the scraper to emulate real-user behavior more and more to defeat the barriers. At the end of the cat and mouse game SO's only option is to block the IP range, or allow scraping from EC2.