3 ms·
Could anti-competitive suit be raised towards google regarding their reCaptcha? They aiming to have (if not already) a crawler blocking tool that obviously does
by kabacha 7y ago
Could anti-competitive suit be raised towards google regarding their reCaptcha? They aiming to have (if not already) a crawler blocking tool that obviously doesn't block their own crawler.
Doesn't that sound a bit dystopian?
- qtplatypus 7y agoYou can block googles crawler with robots.txt
- kabacha 7y agoThat's not very relavant to my proposed problem. Here's an immaginary scenario: recaptcha blocks all crawlers except google's ones, how are competitors supposed to compete if they can't crawl anything despite robots.txt or whatever?
- qtplatypus 7y agoThe purpose of recaptcha is to block malicious bots from accessing parts of a site that automated bots are not supposed to go to. Why would someone be using recaptcha to block bots from the general part of their web site? Your imaginary scenario would require web masters to become hostile to crawlers.
- kabacha 7y ago> web masters to become hostile to crawlers You must have been living under a rock for the past decade, haven't you? Web masters are definitely hostile towards webcrawlers. There's an entire platitude of "web-crawler" protection services - cloudflare for example is probably the biggest one.