4 ms·
Suppose a company allows anyone to access HTTP resources without authenticating. In that case, can people get in trouble for scraping such HTTP resources at sc
by EGreg 7y ago
Suppose a company allows anyone to access HTTP resources without authenticating.
In that case, can people get in trouble for scraping such HTTP resources at scale, all around the Internet?
I am worried not about breaching the TOS, but the kind of "hacking" definition that involves "circumventing the intended use" regardless of technological availability and never agreeing to a single contract.
- rayiner 7y agoIf by “hacking” you’re talking about the CFAA, (1) violating that statute requires knowledge that you’re exceeding authorized access; (2) the Ninth Circuit has held that merely violating the TOS can’t be the basis for a CFAA violation anyway. To go back to the Linked-In example of the article. The predicate for the CFAA claim is not merely scraping. It’s intentionally bypassing technological measures intended to block the scraping, after there was notice that the scrapping was not permitted. It’s very much like real life. If a shop keeper has the door open, he can’t sue you for trespass for walking in and looking around. That’s called implied license. But if he kicks you out and tells you not to come back, you can be prosecuted for trespass if you come back, even if the shop keeper leaves the door open for everyone else. An open web server is similar.
- EGreg 7y agoSo, scraping data at scale is fine until they rate-limit you or cut you off. Which means if you used a botnet and rate-limited yourself "just to be safe" or "just to be nice" without knowing whether they liked it or not, then that's fine.
- onion2k 7y agoThere could be a strong argument that continuing to make additional http requests after the first one constitutes accepting the ToS. If you didn't accept them you shouldn't continue to use the website by making further requests, and you should discard the content of the first request without using it.
- shakna 7y ago> There could be a strong argument that continuing to make additional http requests after the first one constitutes accepting the ToS You generally can't even _see_ the ToS without making further requests.