3 ms·
Lawless or lawful? I don't understand why people hate crawlers that much. I understand arguments about ones that violate robots.txt, but not correct ones.
by theragra 2y ago
Lawless or lawful?
I don't understand why people hate crawlers that much. I understand arguments about ones that violate robots.txt, but not correct ones.