3 ms·
Make a new certificate, let crawlers blast you and add those IPs to a block list.
by CyberDildonics 4mo ago
Make a new certificate, let crawlers blast you and add those IPs to a block list.
- nikcub 4mo agothese old network security techniques don't really work anymore. the common bots are at known IP ranges, the problem bots are all on datacenter + residential proxies.
- CyberDildonics 4mo agoWhy would blocking those be a problem?
- nikcub 4mo agothere are 150M+ of them and you'll be taking out a lot of human users with it modern blocking is behaviour / heuristic based
- CyberDildonics 4mo agoThere are 150 million bots all using residential IP addresses?
- chadgpt3 4mo agobecause you are blocking all of Comcast, Verizon, T-Mobile, British Telecom, .... at the end you have blocked every network with human visitors and only datacenter IPs can access your site. The proxies rotate IP every day, so you either have ineffective blocking or you block the whole network.
- mh- 4mo agoIn my experience, these aren't the crawlers from legit companies, so they have infinite IPs via residential botnets/proxies. edit: 'nikcub beat me to it by 30 seconds :)