4 ms·Naive question, do people no longer respect robots.txt?by mlepath 2y agoNaive question, do people no longer respect robots.txt?