22 ms·
I think adding rule for /search* to your robot is easier way to block google bot
by wejick 8y ago
I think adding rule for /search* to your robot is easier way to block google bot
- dougunplugged 8y agoDon't do this until Google sees your new robots meta directives (or canonical tag) on these pages, that way they will drop from the index. Then you can add this to your robots.txt to prevent it being crawled again.