3 ms·
This would have been a logical part of robots.txt from the beginning. Under an earlier Google this would probably not have been allowed to escalate this far.
by xorcist 7y ago
This would have been a logical part of robots.txt from the beginning. Under an earlier Google this would probably not have been allowed to escalate this far.