5 ms·
This seems to be a bit of a stretch in calling it "full-text search" engine: I only casually browsed the code from my phone so I might have missed it, but I don
by necovek 7y ago
This seems to be a bit of a stretch in calling it "full-text search" engine: I only casually browsed the code from my phone so I might have missed it, but I don't see any support for stemming, which is a critical piece of any FTS engine (with support for many languages, which further complicates stuff).
This seems to be a simple word indexer instead, which is quite a different proposition to FTS.
- taneq 7y agoI'm not overly familiar with search as a field - why is stemming "critical to FTS" rather than a nice enhancement? I would have thought the defining criterion for "full text search" was that it searched the full text of the database?
- ComodoHacker 7y agoThe key is "with support for many languages". For many languages (other than English) with heavy use of suffixes and/or prefixes, FTS without stemming is kind of useless.
- danieldk 7y agoFor many languages, it is even useless with stemming, you would want lemmatization plus a certain amount of fuzzy matching.
- ianai 7y agoI didn’t quite understand what you meant. I saw your comma and thought you were developing another sentence and thought entirely. I understood you meant FTS search needs stemming to be useful after skipping he comma. Just FYI.
- ComodoHacker 7y agoYes, you understood correctly. English is not my native, sorry.
- ianai 7y agoI used to be a heavy comma user. Still am. But try being ‘radical’ and not using a comma more often. (It’s not actually radical at all)
- itronitron 7y agoyou don't need stemming for full text search, although it is a benefit for some text data.