This situation almost screams for web indexing as a service. Would love to see some search engine innovation, especially advanced curation, classification, arch

This situation almost screams for web indexing as a service. Would love to see some search engine innovation, especially advanced curation, classification, archival and filtering(!) abilities.