3 ms·
>scrape my site without permission. No one needs permission to request a web page, and that includes bots. But if that still bothers you, why not create arobot
by falcor84 9y ago
>scrape my site without permission.
No one needs permission to request a web page, and that includes bots. But if that still bothers you, why not create arobots.txt with your preferences?