3 ms·
I don't understand this. You don't have routes your users might need in robots.txt? This article is about bots accessing resources that other might use.
by Capricorn2481 2y ago
I don't understand this. You don't have routes your users might need in robots.txt? This article is about bots accessing resources that other might use.
- IncreasePosts 2y agoIt seems better to put fake honeypot urls in robots.txt, and block any up that accesses those.
- Capricorn2481 2y agoAh I see
- trod1234 2y agoBlocking will never work. You need to impose cost. Set up QoS buckets, slow suspect connections down dramatically (almost to the point of timeout).