4 ms·
I don't know the details of how their crawler works, but it seemed to me that if a page takes more time to serve to the crawler, there would be some lost resour
by kadavy 16y ago
I don't know the details of how their crawler works, but it seemed to me that if a page takes more time to serve to the crawler, there would be some lost resources.
Even so, faster page load time also means higher AdSense CTR, and more money - though I guess you could make an indirect user experience case for that.
- ericd 16y agoThere's bound to be a small amount of memory used by the idle crawler, but if they designed it well, it seems unlikely that that would be a limiting factor. You make a fair point about the AdSense. I would guess they care more about a better user experience, but it's certainly possible. Everything they do can be viewed as a means to keep people searching and using the web, and clicking on more ads.
- barmstrong 16y agoI just left a similar comment on the post - it likely wouldn't affect resources. The ranking bonus from fast loading pages is probably because Google knows humans prefer fast loading sites.