3 ms·
What do you mean by hostile? Do they ban non-Google crawlers?
by MattGaiser 7y ago
What do you mean by hostile? Do they ban non-Google crawlers?
- threatofrain 7y agoYes because it’s harder to verify the intentionality or harmoniousness behind the other bots.