2 ms·
This is silly. If you have a user of your site going through your bots file and specifically going to directories listed as Disallow then you deal with that us
by protomyth 12y ago
This is silly. If you have a user of your site going through your bots file and specifically going to directories listed as Disallow then you deal with that user. Blocking based on the robots.txt for a directory that doesn't exist anywhere but that file is fine. I did a two bad directory ban, it seemed to work fine.