4 ms·

What language would you prefer to see a P2P search engine written in? The main contenders are: * Python, which is very easy to use, with a large ecosystem, bu

What language would you prefer to see a P2P search engine written in? The main contenders are: * Python, which is very easy to use, with a large ecosystem, but also has a larger installation size and would require users to install a few dependencies. * Go, which has some existing p2p libraries and compiles to a small and very fast executable, but is more difficult to implement fancy higher-level data structures or use libraries on. 2. Thank you, https://en.wikipedia.org/wiki/Common_Crawl https://en.wikipedia.org/wiki/Common_Crawl dataset is an interesting dataset. At 320 terabytes it is too large for any one user, but if a few thousand people divided up the tasks they could run interesting queries as part of a p2p network. It would be something to consider including as the network got larger.

r721 4y ago
1) Both are ok imho, I just thought there was a period in 00s when Java was popular for various apps, even for some YouTube downloader you needed it to be installed, and now I didn't see requirements like that for ages. YaCy started in 2003, and I think the language could be one of the reasons the interest in this project waned. 2) I didn't look into Common Crawl closely, but I think they maybe have smaller sample datasets for testing or home projects? It just makes sense to use freely available crawling data which already exists and not wait for people to join your project. P.S. Previous YaCy discussions on HN: https://news.ycombinator.com/from?site=yacy.net https://news.ycombinator.com/from?site=yacy.net , there are some feature requests in comments probably.