4 ms·
Using a 1 pixel transparent GIF works - also worth putting in a warning for screen readers not to follow the link. FWIW I've been using robots.txt honeypots on
by autoreverse 15y ago
Using a 1 pixel transparent GIF works - also worth putting in a warning for screen readers not to follow the link.
FWIW I've been using robots.txt honeypots on two sites for the past few years to deter scrapers. Approx 1,600 IP addresses have been banned. Most of these are for data centers.
- derpy 15y agoFuck you guy, that's pretty pricky. Is bandwidth that expensive for you?
- migrantgeek 15y agoThat's uncalled for. If he owns the data and pays for the connectivity, he should be free to do as he pleases just like I can exclude you from my home or business without justification.
- autoreverse 15y agoI like humans browsing my sites but I certainly don't want scrapers copying my work wholesale, claiming it as their own and ranking ahead of me in SERPs. I'm not alone :-) see http://incredibill.blogspot.com/ http://incredibill.blogspot.com/