4 ms·
Is common crawl usable in this context? http://commoncrawl.org/ http://commoncrawl.org/
by hyko 6y ago
Is common crawl usable in this context? http://commoncrawl.org/ http://commoncrawl.org/
- jamesponddotco 6y agoKinda. The crawler is there, still missing the search engine. Think Google, but open source, and maybe self-hostable[1]. [1] I am pretty sure "hostable" is not a word.
- thomas536 6y agoThe only public search engine that I'm aware of using common crawl is ChatNoir. https://groups.google.com/d/msg/common-crawl/3o2dOHpeRxo/H2Osqz9dAAAJ https://groups.google.com/d/msg/common-crawl/3o2dOHpeRxo/H2O...