4 ms·

Isn't this a problem for a CAPTCHA?

• jackowayed 16y ago
  No. If the content is only accessible after you fill out a CAPTCHA, Google won't be able to index your content, and you won't have any visitors for scrapers to steal from you. I suppose you could provide the content without a CAPTCHA if the user agent matches the crawlers of Google, Bing, etc. But it's still a bad idea because a lot (most?) of your users will bounce on the CAPTCHA, killing your ad revenue.
  • damncabbage 16y ago
    ... And it's very easy to just impersonate the GoogleBot by using its User-Agent.
    • sursani 16y ago
      Ditto.. there is no point trying to prevent certain bots, etc from scraping your content. It's a never ending battle. Just like all the others said before me, if it's your content, you should be fine.