3 ms·
No, different datacenters will show different results... sometimes very different. It also matters if you are visiting Google.com or one of the country variants
by mvandemar 17y ago
No, different datacenters will show different results... sometimes very different. It also matters if you are visiting Google.com or one of the country variants.
According to what Jason said in another comment, however, all of their pages are listed in their xml sitemap, and all of those are listed in a master xml sitemap index located here (warning! huge files if you follow the links in the first one!):
http://www.mahalo.com/sitemapindex.xml http://www.mahalo.com/sitemapindex.xml
Based on what I saw 2 million+ looks like a huge overestimate, if what Jason said is true.
Edit: My bad, frederickcook's answer was the right one. I didn't realize you were doing a regular text search.
- chronomex 17y agoThere are 12 sitemap-mahalo.xml files, each with 50,000 urls in it. The 12th has 48,661 urls by my count. That gives a total size of 598,661 pages. Methodology: wget http://www.mahalo.com/sitemapindex.xml cat sitemapindex.xml |sed -e's/[<>]/\n/g'|grep ^http|xargs wget for P in sitemap-mahalo.xml* ; do echo $P ; cat $P |sed -e's/[<>]/\n/g'|grep ^http|wc -l ; done Edit: Formatting