Part 2, is already there http://engineering.bloomreach.com/crawling-billions-of-pages-building-large-scale-crawling-cluster-part-2/ http://engineering.bloomreac

Part 2, is already there http://engineering.bloomreach.com/crawling-billions-of-pages-building-large-scale-crawling-cluster-part-2/ http://engineering.bloomreach.com/crawling-billions-of-pages...