Regarding the scraping and the legality of it all. I wonder if it's still illegal if you respect the robots.txt and other meta elements in html standards. If G

Regarding the scraping and the legality of it all. I wonder if it's still illegal if you respect the robots.txt and other meta elements in html standards. If Google's actions were illegal, I'm sure that they would have been sued even if their scraping and indexing usually is helpful for the website owner