3 ms·
How about distributed crawlers coupled with a distributed datastore similar to Freenet? Your browser automatically crawls the pages you visit and adds the info
by Santosh83 5y ago
How about distributed crawlers coupled with a distributed datastore similar to Freenet?
Your browser automatically crawls the pages you visit and adds the info to the distributed index that is also stored on all participating machines (perhaps with a copy on the cloud for query performance). Though a single browser may visit only a few pages, we ought to get a pretty good WWW index from the combined crawling of millions of browsers.
Main advantage would be resistance to censorship.
- gostsamo 5y agoSome indexes are really big. Plus, when you index a page, you must be sure that you are not indexing your email inbox. It would be better if the index is on the cloud, while the crawlers are distributed, but are not part of your browser.