5 ms·

“Google is wrapping knowledge up in answer cards and not sending traffic”

• landtco 12y ago
  Interesting convo here: http://www.reddit.com/r/technology/comments/2jt0n8/every_fact_google_knows_about_it_knows_from/ http://www.reddit.com/r/technology/comments/2jt0n8/every_fac...
• anigbrowl 12y ago
  Interesting, but the title is confusing. Better to use the original in this case.
• walterbell 12y ago
  Is there a generic list of defense techniques against scrapers, including but not limited to Google? E.g. move some content behind a login wall?
  • landtco 12y ago
    In theory, you can disallow crawlers and bots via robots.txt. It's not a hard defense per se because crawlers can ignore it.