3 ms·
Could that be a honeypot to trap bots that don't respect robots.txt?
by IgorPartola 12y ago
Could that be a honeypot to trap bots that don't respect robots.txt?
- prokizzle 12y agomaybe, but why would THAT be the honey pot? it could be any phrase, really.
- IgorPartola 12y agoWell, you'd want them to try to crawl it. Perhaps there was a bot crawling their site for such links and they wanted to identify specifically that one. It seems most likely that such URL's never existed, but this would be a decent way to identify a bot that's otherwise not distinguishable.
- huhtenberg 12y agoLooks more like a mop-up after a website infection incident.
- ashmud 12y agoI have had to do that before. The URLs in that case seemed to have a more random distribution than most of these.