4 ms·

Elasticsearch is absolute garbage for text search such as articles or comments. Text contains 'foocompany.com', and you search for 'company.com'? No results. It

by tpxl 4y ago

Elasticsearch is absolute garbage for text search such as articles or comments. Text contains 'foocompany.com', and you search for 'company.com'? No results. It also tends to ignore punctuation (not sure whether this is configurable or not). Please let me keep simple word search.

Cyberdog 4y ago
> Text contains 'foocompany.com', and you search for 'company.com'? No results. Well… yes… I mean, you could probably make that causing a hit with some stemming if you wanted to, but that seems like reasonable behavior to me. If you meant to give an example more along the lines of "singer" and "singing" not matching, again, that's a job for stemming. The feature is there; it just needs to be enabled.
- tpxl 4y ago
  > I mean, you could probably make that causing a hit with some stemming if you wanted to A simple String.contains() gets you there, and that is the behaviour of grep, and most tools behaved that way too in the past (and still do, if they don't use ES). > The feature is there; it just needs to be enabled. It's not enabled in Discord (afaik uses ES), Slack (afaik uses ES?) nor Kibana (ES). What use is a feature if it's never used? I'm sure there's plenty good things you can do with elasticsearch, but the things I use daily that use it are absolutely infuriating.
WASDx 4y ago
How it treats punctuation is indeed configurable, you can index data in multiple ways to allow the choice to be made at search time. It can also be contextually aware to distinguish for instance end-of-sentence dots from domain name or math expression dots. Matching "foocompany.com" from "company.com" can be achieved with a wildcard or fuzzy search. If you specify an exact match then that's what you get.
winternett 4y ago
Agreed here too... Unstructured data search tools leave too much for spammers to work with (especially when intense moderation and grooming of sources is not involved)... The accuracy of results (In cases like HN search) is inherently flawed with unstructured data in mission critical settings unless there is an intentionally limited set of resources and contributors... Limiting contributors and resources also often defeats the purpose of maintaining a wide variety of accurate and diverse resources and results.

by tpxl 4y ago

Cyberdog 4y ago

> Text contains 'foocompany.com', and you search for 'company.com'? No results. Well… yes… I mean, you could probably make that causing a hit with some stemming if you wanted to, but that seems like reasonable behavior to me. If you meant to give an example more along the lines of "singer" and "singing" not matching, again, that's a job for stemming. The feature is there; it just needs to be enabled.

tpxl 4y ago
> I mean, you could probably make that causing a hit with some stemming if you wanted to A simple String.contains() gets you there, and that is the behaviour of grep, and most tools behaved that way too in the past (and still do, if they don't use ES). > The feature is there; it just needs to be enabled. It's not enabled in Discord (afaik uses ES), Slack (afaik uses ES?) nor Kibana (ES). What use is a feature if it's never used? I'm sure there's plenty good things you can do with elasticsearch, but the things I use daily that use it are absolutely infuriating.

WASDx 4y ago

How it treats punctuation is indeed configurable, you can index data in multiple ways to allow the choice to be made at search time. It can also be contextually aware to distinguish for instance end-of-sentence dots from domain name or math expression dots. Matching "foocompany.com" from "company.com" can be achieved with a wildcard or fuzzy search. If you specify an exact match then that's what you get.

winternett 4y ago

Agreed here too... Unstructured data search tools leave too much for spammers to work with (especially when intense moderation and grooming of sources is not involved)... The accuracy of results (In cases like HN search) is inherently flawed with unstructured data in mission critical settings unless there is an intentionally limited set of resources and contributors... Limiting contributors and resources also often defeats the purpose of maintaining a wide variety of accurate and diverse resources and results.