3 ms·
They say, "Anytime we see a referrer from serach.live.com, we check if the IP is in the range of known IP addresses for their crawler, and if so, we just ignore
by CalmQuiet 18y ago
They say, "Anytime we see a referrer from serach.live.com, we check if the IP is in the range of known IP addresses for their crawler, and if so, we just ignore it."
I filter some stats according to user agent name: Anybody know if these bots use regular (honest) agent names? Or do I need to start searching for "range of knw IP addresses for their crawler?" (Anyone care to share such a range?