4 ms·The article mentions that they tried that and the crawler ignored it.by DreadY2K 6y agoThe article mentions that they tried that and the crawler ignored it.