In the US, where all these companies are based, it is legal to scrape any site that doesn't require a login regardless of the robots.txt file. However, what yo

In the US, where all these companies are based, it is legal to scrape any site that doesn't require a login regardless of the robots.txt file. However, what you do with that data is still subject to copyright law.