4 ms·
Surely there are solutions more subtle than blocking 80% of the world population...
by GuB-42 1y ago
Surely there are solutions more subtle than blocking 80% of the world population...
- sumtechguy 1y agois there an http code for 'hey I gave you this already 10 times. This is a you problem not a me problem I refuse to give you another copy'. It also sounds like there is an opportunity to sell scraped data to these companies. Instead of 10 crawlers we get one crawler and they just resell/give it away. More honey pots doesnt really fix the root cause (which is greed).
- GuB-42 1y ago> is there an http code for 'hey I gave you this already 10 times. 429 Too Many Requests > This is a you problem not a me problem That's the "4" in "429"
- bakugo 1y agoI should've made it clear that it's not a block rule, just a challenge rule. Those people can still access the website, they just have to go through the "checking your browser" page that you're probably familiar with. As I said, you can just enable that for everyone and be done with it, but with a custom rule, you can avoid showing it to people that are unlikely to be bots.