4 ms·Can't you just not allow in robots.txt? All mejor search engines respect that.by sergiotapia 13y agoCan't you just not allow in robots.txt? All mejor search engines respect that.