3 ms·
How would tf-idf help fuzzy match names? You would first need to decide the term youre looking for is the term you've indexed, which is what soundex &c would do
by jimktrains2 6y ago
How would tf-idf help fuzzy match names? You would first need to decide the term youre looking for is the term you've indexed, which is what soundex &c would do.
- fumblebee 6y agoSoundex is a useful option for reducing the search space (the blocking stage, with aims to have a high recall). TF-IDF is a useful option as part of a high precision pipeline _post_ blocking. A two step pipeline is typical and necessary because the high precision pipeline, while more accurate than the blocking algorithm, suffers from being slow.
- sandGorgon 6y agoI work in non-English markets. Soundex is not a general replacement. Similaritiy search (https://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules-similarity.html https://www.elastic.co/guide/en/elasticsearch/reference/curr...) is far better assuming you have some corpus already.