2 ms·

Isn't this an issue with the robots.txt? A clause in some ToS was never going to stop any web scraping.