4 ms·
Ask HN: Is scraping webpages for research purposes considered legal
- viraptor 8y agoDepends on a country. And in practice on how much money the people behind the website can throw at the lawyers when annoyed. For the US you may want to read about https://en.wikipedia.org/wiki/Aaron_Swartz https://en.wikipedia.org/wiki/Aaron_Swartz
- Petrakis 8y agoAlso depends on the ToS of each page, and their robots.txt should allow or disallow crawling
- brudgers 8y agoIf it matters pay a lawyer for a legal opinion. If it doesn't matter, it doesn't matter. Good luck.