3 ms·
A possible pragmatic solution would be to track the site and spot ownership changes and freeze the robots.txt when it happens. Reliable ownership change detect
by ithkuil 14y ago
A possible pragmatic solution would be to track the site and spot ownership changes and freeze the robots.txt when it happens.
Reliable ownership change detection can be tricky though, but it's doable IMHO.