4 ms·
This is a great question, one that is very important to our business [0] which crawls many of the major social media platforms. Andy Sellars [1] published a pa
by doh 7y ago
This is a great question, one that is very important to our business [0] which crawls many of the major social media platforms.
Andy Sellars [1] published a paper year ago on the topic titled "Twenty Years of Web Scraping and the Computer Fraud and Abuse Act" [2] which puts the topic in a great perspective. Many of the cases are not very clear cut and sway from one direction to another. We are currently in the up where courts side with the "crawlers" which may change in couple of years.
[0] https://pex.com https://pex.com
[1] https://twitter.com/andy_sellars https://twitter.com/andy_sellars
[2] https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3221625 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3221625