4 ms·
Does anyone know how to play with relevance and spell corrections in FTS ? In elasticsearch, relevance is Tf-IDF or BM25. I don't see anything similar in FTS.
by sandGorgon 9y ago
Does anyone know how to play with relevance and spell corrections in FTS ?
In elasticsearch, relevance is Tf-IDF or BM25. I don't see anything similar in FTS.
Not sure how I can results around ranking as well as spell correction/suggestions simultaneously.
- pauloxnet 9y agoI used Elastic in past project as I reported in my article, but I never used relevance, can you add a link to the elastic official documentation about it ?
- softwaredoug 9y agoI might shamelessly plug my own book, Relevant Search (http://Manning.com/books/relevant-search http://Manning.com/books/relevant-search) which introduces relevance on Elasticsearch. Ping me (http://o19s.com/doug http://o19s.com/doug) if you’d like a discount code!
- sandGorgon 9y agohere - https://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules-similarity.html https://www.elastic.co/guide/en/elasticsearch/reference/curr... similarity/relevance is the mathematical difference between search and database query. Its an inexact match.
- pauloxnet 9y agoThanks. I'll read it.
- burntsushi 9y agoIf you want to reason about these things from first principles, then I recommend the IR book, which is free online: https://nlp.stanford.edu/IR-book/ https://nlp.stanford.edu/IR-book/
- rpedela 9y agoDepending on the ES version, it either does TF/IDF (older versions) or BM25 (newer versions) by default. You have to explicitly disable it if you don't want it. https://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules-similarity.html https://www.elastic.co/guide/en/elasticsearch/reference/curr...
- rpedela 9y agoAs far as I am aware, you cannot get ES/Solr quality ranking + fuzzy search out of the box.
- pauloxnet 9y agoI think it depends on your specific situation and your project requirements. In my project for example I had exactly the search quality I need with Django and PostgreSQL without installing another software (Elastic), using a different query syntax, synchronizing the data and installing another layer (haystack). Maybe in other project ES will be a better solutions.
- rpedela 9y agoMy comment was in response to a question whether PG can do TF/IDF or BM25 and fuzzy search (handle misspelling) simultaneously. And as far as I am aware, PG cannot do it. My comment had nothing to do with your blog post.