For what it's worth, we actually are helping new search engines scale their capabilities. ..and not just on crawling (or indexing, as most people confuse it),

For what it's worth, we actually are helping new search engines scale their capabilities. ..and not just on crawling (or indexing, as most people confuse it), but also on applying their search technology. There are a ton of really cool search technologies (NLP, deep web, media analysis, etc.) out there that don't have the processing power to apply their stuff to billions of web pages. That's a big stumbling block for these guys. Google's #1 competitive advantage (IMHO) is its low operating cost (achieved through hundreds of millions of dollars in CapEx).