Google: Please make your pages easy to scrape, we’ll incentivise you to do so Also Google: If we detect you’re scraping us or any of our “partners” (read: the

Google: Please make your pages easy to scrape, we’ll incentivise you to do so Also Google: If we detect you’re scraping us or any of our “partners” (read: the public web) we’ll shut you down. We have ways of ensuring we’re the only bot capable of indexing the web. Heard of web fingerprinting?