3 ms·
Or stop defending individually and start attacking collectively ? This is an issue on scrapers side, they have to fix it > make following robots.txt a legal re
by rakoo 2y ago
Or stop defending individually and start attacking collectively ? This is an issue on scrapers side, they have to fix it
> make following robots.txt a legal requirement
Even better: make them publish their IP addresses so we know what to block, just like robocallers. Every scrape made from another IP is crime.