3 ms·
> Is it possible that these are scrapers using fake UA strings? I now believe this is the case
by 7373737373 2y ago
> Is it possible that these are scrapers using fake UA strings?
I now believe this is the case
- nextaccountic 2y agoYou need to check if the requests come from Googlebot's IP ranges https://developers.google.com/search/docs/crawling-indexing/verifying-googlebot https://developers.google.com/search/docs/crawling-indexing/... https://searchengineland.com/google-publishes-the-list-of-googlebot-ip-addresses-375935 https://searchengineland.com/google-publishes-the-list-of-go... https://developers.google.com/search/apis/ipranges/googlebot.json https://developers.google.com/search/apis/ipranges/googlebot...