4 ms·Crawlers/archivers will be hitting your site much faster than a human user.by SoftTalker 2y agoCrawlers/archivers will be hitting your site much faster than a human user.