3 ms·
If it’s a clear message, they will simply avoid your AI identification heuristics. Better to feed them 404s so they eventually give up (or you drop their reques
by toomuchtodo 2y ago
If it’s a clear message, they will simply avoid your AI identification heuristics. Better to feed them 404s so they eventually give up (or you drop their requests with no response, assuming known IP blocks crawls originate from). The less signal provided, the better, broadly speaking.
- gigaArpit 2y agoFollowing this reasoning, a 200 response would also be appropriate, as AI bots wouldn't flag anything as suspicious.