It will entrench established search engines even more if they have to move to auth-based crawling, so that the only crawlers will be those you invite. Most peop

It will entrench established search engines even more if they have to move to auth-based crawling, so that the only crawlers will be those you invite. Most people will do this for google, bing, and maybe one or two others if there is a simple tool to do so.