3 ms·
YaCy is too slow for mainstream use. I believe the indices still need to be centralized, only index-building and crawling can be distributed.
by _xnmw 5y ago
YaCy is too slow for mainstream use. I believe the indices still need to be centralized, only index-building and crawling can be distributed.
- marginalia_nu 5y agoA big part of the problem I see with decentralized search is that you basically need to traverse the index in orthogonal axes to assemble search results. First you need to search word-wise in order to get result candidates, then sort them rank-wise to get relevant results (this also hinges upon an agreed-upon ranking of domains). That's a damn hard nut to crack for a distributed system. Crawling is also not as resource consuming as you might think. Sure you can distribute it, but there isn't a huge benefit to this.