3 ms·
So ban the googlebot in robots.txt and tell google you'll let them back in when they let you crawl their site.
by tedunangst 10y ago
So ban the googlebot in robots.txt and tell google you'll let them back in when they let you crawl their site.
- __b__ 10y agoOr allow Googlebot in robots.txt and then crawl Google.