3 ms·
I also find it strange that there are no 304 status codes. Does that mean that they blindly download each page when they update their index? Unless you are Goo
by ks 18y ago
I also find it strange that there are no 304 status codes. Does that mean that they blindly download each page when they update their index?
Unless you are Google or Yahoo with thousands of servers, you could save some time by only processing pages that have actually been modified.