6 ms·Monitor access logs for links that only crawlers can find. Edit: oh, I got your point now.by keisborg 2y agoMonitor access logs for links that only crawlers can find. Edit: oh, I got your point now.