3 ms·
All of the things that look like search engines get their results from Google, Bing, or (occasionally) Yandex. Building your own big search index is not somethi
by greglindahl 10y ago
All of the things that look like search engines get their results from Google, Bing, or (occasionally) Yandex. Building your own big search index is not something you can raise $1 million and just go do.
- deusu 10y agoYou can do your own search-index with 2.3 billion pages for about €300/month: https://deusu.org https://deusu.org
- greglindahl 10y agoI think your project is great for how it does so much with so few resources, but most big search engines have an index which is more than 1,000X as large as yours (per document), in order to improve results.
- AznHisoka 10y agoMoz, ahrefs , majestic.. They all have built their own search index. It's not trivial but it's not Google-hard either.
- greglindahl 10y agoAll of these provide lists of backlinks. That's a bit different from providing high-quality search results. Also, I don't think that any of them have a budget as small as $1 million.
- pbhjpbhj 10y ago>Building your own big search index ... // The guy who started DDG [https://news.ycombinator.com/user?id=epi0Bauqu https://news.ycombinator.com/user?id=epi0Bauqu] shared a lot of his solo search engine creation here. At one point at least he was running his own crawlers/index (but not IIRC exclusively). It might be instructive to search over past posts and find the details. I don't think he was using anything like $1 million as, again IIRC, it was self funded. But this was a few years (10?) ago now.