2 ms·They don't read robots.txt anyways so it doesn't matter.by xena 16d agoThey don't read robots.txt anyways so it doesn't matter.