4 ms·
Of course it's your choice to make. Is someone forcing you to respond to requests you'd prefer to ignore?
by jMyles 3y ago
Of course it's your choice to make.
Is someone forcing you to respond to requests you'd prefer to ignore?
- paulryanrogers 3y agoIf crawlers are stealth DDoSing my site then I lose the ability to respond entirely.
- theamk 3y agoyes, people like OP who get the farms of scrapers. The website owners make their preferences clear with robots.txt, IP blocks and other antibot technology. Scrapers intentionally ignore owners' desires and force the to respond.