2 ms·
Putting it in robots.txt is like advertising to bad bots exactly where to go. Exactly. Right to your special page that earns a 24 hour ip ban. It doesn't take
by tomjen3 16y ago
Putting it in robots.txt is like advertising to bad bots exactly where to go.
Exactly. Right to your special page that earns a 24 hour ip ban.
It doesn't take that long to code and should keep any bot away.