A few years back I setup a Yacy crawler. My IP soon appeared on blacklists (SMTP, etc). I'd force-swap IPs and a few days later I'd be blacklisted again. Anoth

A few years back I setup a Yacy crawler. My IP soon appeared on blacklists (SMTP, etc). I'd force-swap IPs and a few days later I'd be blacklisted again. Another poster here built his own crawler and kept getting DDoS'd by botnets. Search-crawling seems to elicit some hostility.