3 ms·
The requirements in infrastructure are not symmetrical here. An indexer requires a significantly bigger investment in both storage and computational power than
by MadWombat 7y ago
The requirements in infrastructure are not symmetrical here. An indexer requires a significantly bigger investment in both storage and computational power than either a crawler or an end-user site. Seems like everyone would want to run a crawler, but nobody would want to run an indexer.
Also, it is unclear how to start something like this. A sort of a chicken and egg problem where you cannot start running any of these components because there is nobody running the other parts.
- drmabus 7y agothe egg came first. on a serious note, yacy is good enough to crawl a bunch of sites you like and get much superior search results be it limited to your own interest. google is complete garbage. specially nowadays google just returns unrelated cnn pages. try search for corona virus map, I get tons of news articles talking about the same page but the page is not in the results. whatever you add to the query it keeps returning the same news articles from the same sources. if you populate yacy with pages about the topic you will yield real results.
- drivebycomment 7y agoI just tried "coronavirus map" and it showed maps or an article with map from WP, CNN, NYT. And one from CDC. That looks reasonable to me. Edit: checking the result again, the first page also has a europe.eu page with a map, and another from arcgis.com with a map. So most of the first page results seem highly relevant and good quality.
- MadWombat 7y agoSo far, Google search results are far better than everything else I tried. Granted, I haven't tried yacy, but I doubt it would have the type of data aggregation that makes Google results what they are.