3 ms·
I reod some people use false slugs in the robots.txt as a honey pot of sorts. IPs that actually read the robots.txt, ignore the disallow, and still access the u
by toastal 5y ago
I reod some people use false slugs in the robots.txt as a honey pot of sorts. IPs that actually read the robots.txt, ignore the disallow, and still access the uri are outright banned.
- jedberg 5y agoHa, that would have been a really smart idea! Sadly we didn't think of that at the time. But we had other honey pot URLs.
- taylorfinley 5y agoThen when a flamewar breaks out you just have to get your adversary to click a link to get them IP banned.