3 ms·
Internet-scale web crawlers are hard to hide. You can just set up a bunch of domains, and flag any IPs that repeatedly visit them as likely crawlers; then serv
by marginalia_nu 3y ago
Internet-scale web crawlers are hard to hide. You can just set up a bunch of domains, and flag any IPs that repeatedly visit them as likely crawlers; then serve malicious content to the rest.