3 ms·
I don't understand why a user would access a randomly created directory that is only mentioned in the robots.txt file. Can you explain as to why you'd think the
by comeonnow 11y ago
I don't understand why a user would access a randomly created directory that is only mentioned in the robots.txt file. Can you explain as to why you'd think they'd stumble across this?
- gpvos 11y agoCuriosity?
- psykovsky 11y agoCuriosity killed the cat, or so they say.
- beaumartinez 11y ago"But satisfaction brought him back."
- gpvos 11y agoAs long as the block lasts not more than a few days, as he says in a nearby comment, I don't think it's much of a problem.
- psykovsky 11y agoOh, believe me they only last a few days at most. I don't use an infinite IP blocklist. It has like 100 IP's or so. When one goes in, one must come out. And lets just say there are enough badly behaved bots around that it doesn't take much time for 100 IP's to rotate.
- protomyth 11y agoThis is silly. If you have a user of your site going through your bots file and specifically going to directories listed as Disallow then you deal with that user. Blocking based on the robots.txt for a directory that doesn't exist anywhere but that file is fine. I did a two bad directory ban, it seemed to work fine.
- kjjw 11y agoI don't think that they would. But users share IPs.