3 ms·
I am sure this already exists even as I type it, but this sounds like a great job for a distributed system running a federated search protocol.
by cabaalis 8y ago
I am sure this already exists even as I type it, but this sounds like a great job for a distributed system running a federated search protocol.
- guix992 8y agoThe hard part is already solved, you don't even have to crawl the web to build the index. There is already a periodically refreshed index of the web that you can download: commoncrawl.org Now someone just needs to configure, Apache Lucene as a proper docker image that can consume this index.