3 ms·It’s legal but if you don’t consent to people doing it in your robots.txt you can sue them civillyby mountainriver 4y agoIt’s legal but if you don’t consent to people doing it in your robots.txt you can sue them civilly