3 ms·
Today, Google even crawls, renders and indexes URLs sent from Chrome browsers via dial-up IPs using regular browser User-agents, so... no. Other than that, Goog
by rbinv 6y ago
Today, Google even crawls, renders and indexes URLs sent from Chrome browsers via dial-up IPs using regular browser User-agents, so... no. Other than that, Googlebot seems to obey most of the time.
I don't blame them. Cloaking couldn't be detected otherwise.
- toper-centage 6y agoI think i read somewhere that Google crawlers sometimes pretend to be real browsers to prevent you from displaying a different page the crawler. So, no.