4 ms·
If you disobey robots.txt it's unethical and rude.
by chinathrow 11y ago
If you disobey robots.txt it's unethical and rude.
- snowwrestler 11y agoI agree, but running a scraper does not necessarily mean disobeying robots.txt.
loading thread…
4 ms·