5 ms·
The donations are great for open source projects. I just wonder if DDG is investing in their own crawler? With Yahoo BOSSS API bite the dust therefor loosing a
by frik 10y ago
The donations are great for open source projects.
I just wonder if DDG is investing in their own crawler? With Yahoo BOSSS API bite the dust therefor loosing access to Bing search result. DDG nowadays has to rely on Yandex (Russian search engine) for their search result. The search results of DDG have gone from okay to a bit worse, so what's their long term strategy? Stay a meta-search-engine, or invest major resources to crawl the web themselves? What many people hate is high latency and to lower latency you cannot rely on third party APIs for the main search.
- amelius 10y agoJust wondering, how many GB per second does a modern search engine have to crawl?
- Sephr 10y agoThere is an official Bing API coming out soon (a Bing developer recently mentioned this in an HN thread a couple days ago, although I can't find it atm), so they won't have to rely on Yandex for much longer. I have no idea if the pricing will be comparable to Yahoo BOSS though.