2 ms·
If a site disobeys robots.txt, I see no particular issue in taking further measures to dissuade it.
by rsynnott 7y ago
If a site disobeys robots.txt, I see no particular issue in taking further measures to dissuade it.
- deleted 7y ago[deleted]
2 ms·