3 ms·

Yeah wtf? Everyone let's Google crawl their site but it's naughty for anyone else to do it... such bullshit!

• jmngomes 9y ago
  Probably because scraping by search engines is a transaction that benefits both sides, as search engines bring traffic to the content's source. "it's naughty for anyone else to do it" if that everyone are companies that will be using or monetizing that content without providing any kind of attribution or compensation to the source/creator.
  • tomascot 9y ago
    Except now that Google shows the info directly in the search results.
  • taken__-- 9y ago
    Google isn't the only search engine.