28 ms·
Has anyone done research on the topic of trying to block these bots by claiming to host illegal material or talking about certain topics? I mean having a few en
by dormento 8mo ago
Has anyone done research on the topic of trying to block these bots by claiming to host illegal material or talking about certain topics? I mean having a few entries in your robots like "/kill-president", "/illegal-music-downloads", "/casino-lucky-tiger-777" etc.
- pousada 8mo agoYea I can’t see how that could backfire in any way
- DetroitThrow 8mo agoFB crawler is used for national security reasons at times. The first would probably make it more active.