3 ms·
Crawling for the Search Index != Browsing on the Users behalf. I guess that's the difference here. Would be nice to have the correct user-agent for both, but
by anotheryou 2y ago
Crawling for the Search Index != Browsing on the Users behalf.
I guess that's the difference here.
Would be nice to have the correct user-agent for both, but was probably not malicious intent and arguably a human browsing by proxy.