4 ms·
Also, for consideration: Bleve (https://github.com/blevesearch/bleve https://github.com/blevesearch/bleve) I'm in the process of building my own search engine
by Jemaclus 9y ago
Also, for consideration: Bleve (https://github.com/blevesearch/bleve https://github.com/blevesearch/bleve)
I'm in the process of building my own search engine (as a learning exercise, but also because it's related to my day job). I've learned that it's one thing to write a full-text search engine, like this one, and it's quite another to do field-specific searches with faceting support and so on, like Algolia and Lucene-based search engines do.
That said, this is clean and simple. I like it. I can definitely learn from this.
- CSDude 9y agoLast time I checked, bleeve was very slow compared to Lucene, I really hope it gets better over time.
- markpapadakis 9y agoSupporting faced search and other functionality requiring access to per document field-values is just an extension over the core IR functionality. Tracking (document, field) values can be used for query by range or by geolocation primitives (that's what Lucene does, where it will index that data into a special tree-like structure, and for each query, it will build a custom 'iterator' and use it along with other iterators to match documents), and for static ranking of matched documents. BTW, Lucene and Algolia are vastly different in terms of the underlying architecture.
- lobster_johnson 9y agoWhat is Algolia's underlying architecture like? Are there any papers or code?
- markpapadakis 9y agoSee links about Algolia arch (and other related material) here: https://github.com/phaistos-networks/Trinity/wiki/IR-Search-Links https://github.com/phaistos-networks/Trinity/wiki/IR-Search-...
- gdillon 9y agoThanks for the links, Mark! (Disclaimer, I work for Algolia.) As Mark mentions on his summary page, the best place for that kind of information is our CTO's "Inside the Engine" series (8 parts). https://blog.algolia.com/inside-the-algolia-engine-part-1-indexing-vs-search/ https://blog.algolia.com/inside-the-algolia-engine-part-1-in...
- Jemaclus 9y agoThat's why I mentioned them separately. :)
- StreamBright 9y agoI was planning to write one too, wanna team up? :)
- amelius 9y agoCould you please include a bibliography in your project? That way, others can more easily find which techniques you are using, and of course it can help others (or even your future self) in figuring out how the code works.