2 ms·The other sites probably just haven't processed the robots.txt change yet and will in the near future.by TheDong 12y agoThe other sites probably just haven't processed the robots.txt change yet and will in the near future.