Maybe the practical indexing ability is worth more than the index itself. Most site owners happily let the Googlebot into their websites, while a competitor is

Maybe the practical indexing ability is worth more than the index itself. Most site owners happily let the Googlebot into their websites, while a competitor is likely to be caught into some sweeping anti-bot/Captcha measures.