4 ms·
I would pay up to $120 per month for a search engine that had its own crawler, and was completely open source, as long as it worked with JS disabled. The crawl
by jamesponddotco 6y ago
I would pay up to $120 per month for a search engine that had its own crawler, and was completely open source, as long as it worked with JS disabled.
The crawler is, arguably, the hardest part. We have open source search engines out there, like searx[1], but most of them are search aggregators, and depend on Google, Bing, and a few other established search engines.
[1] https://github.com/asciimoo/searx https://github.com/asciimoo/searx
- hyko 6y agoIs common crawl usable in this context? http://commoncrawl.org/ http://commoncrawl.org/
- jamesponddotco 6y agoKinda. The crawler is there, still missing the search engine. Think Google, but open source, and maybe self-hostable[1]. [1] I am pretty sure "hostable" is not a word.
- thomas536 6y agoThe only public search engine that I'm aware of using common crawl is ChatNoir. https://groups.google.com/d/msg/common-crawl/3o2dOHpeRxo/H2Osqz9dAAAJ https://groups.google.com/d/msg/common-crawl/3o2dOHpeRxo/H2O...
- jolmg 6y ago> $120 per month Though I'm curious if there's an actual market for a monthly-subscription Google competitor, I very much doubt this bid would be representative of it.
- jamesponddotco 6y agoI do not think there is a market for this — a big one, anyway —, and agree that what I would pay is not representative of what others would, I was just answering the question ¯\_(ツ)_/¯
- thomas536 6y ago+1 I appreciate your answer!