3 ms·
Scraping may violate of Google's own acceptable use policy, but it's not illegal.
by jchook 6y ago
Scraping may violate of Google's own acceptable use policy, but it's not illegal.
- dylan604 6y agoSure, it's only okay for Google to scrape all websites, but not you scraping it. Got it.
- samatman 6y agoGoogle is quite scrupulous about robots.txt. There's plenty of hypocrisy at that company but this doesn't strike me as a case of it.
- decasteve 6y agoScrupulous? Nobody is going to disallow / on Google's user-agent. I'd suggest respecting Google's robots.txt as much as Google respects our DNT settings.