4 ms·
How about a trap URL in the Robots.txt file that triggers a 24 hour IP ban if you access it. If you don't want anyone innocent caught in the crossfire, you cou
by Dwedit 2y ago
How about a trap URL in the Robots.txt file that triggers a 24 hour IP ban if you access it.
If you don't want anyone innocent caught in the crossfire, you could make the triggering URL customized to their IP address.
- ldoughty 2y agoWouldn't help in this case, the post author banned the bot in the robots for, but then when asked the bot to fetch his web page explicitly by URL... If a user has a bot directly acting on their behalf (not for training), I think that's fair use... And important to think twice before we block that, since it will be used for accessibility.
- tommy_axle 2y agoIP banning might be limited if they're already using a proxy network, which is par nowadays for avoiding detection.
- fullspectrumdev 2y agoThis actually might work for fucking over certain web vulnerability scanners that will hit robots.txt to perform path/content discovery - have some trap urls that serve up deflate bombs and then ban the IP.