3 ms·
There are 12 sitemap-mahalo.xml files, each with 50,000 urls in it. The 12th has 48,661 urls by my count. That gives a total size of 598,661 pages. Methodolo
by chronomex 17y ago
There are 12 sitemap-mahalo.xml files, each with 50,000 urls in it. The 12th has 48,661 urls by my count. That gives a total size of 598,661 pages.
Methodology:
wget http://www.mahalo.com/sitemapindex.xml
cat sitemapindex.xml |sed -e's/[<>]/\n/g'|grep ^http|xargs wget
for P in sitemap-mahalo.xml* ; do echo $P ; cat $P |sed -e's/[<>]/\n/g'|grep ^http|wc -l ; done
Edit: Formatting