3 ms·
Wouldn't that be considered illegal due to the same reasons as scraping?
by LunaSea 7y ago
Wouldn't that be considered illegal due to the same reasons as scraping?
- hnick 7y agoI don't think scraping is illegal, unless you're hitting protected pages behind a login after agreeing to a Terms of Service, or hitting it so often you'd constitute a DOS attack. An implied TOS notice on a separate page or footer is not considered enforceable last time I checked, likewise for robots.txt.
- pxtail 7y agoLol, of course not - it would be (and will be!) illegal if you would be doing it, google can crawl and scrape whatever it wants.