3 ms·
It may be a silly question, but isn't there really a simple to use full-text search solution that has all complicated multi-language tricks baked in for all maj
by krick 2y ago
It may be a silly question, but isn't there really a simple to use full-text search solution that has all complicated multi-language tricks baked in for all major languages? Or, well, at least European ones.
It was a really, really hard task 20 years ago, but I'd imagine that now there must be a drop-in grep/ag replacement for natural languages that you run once to build an index and it takes care of all this stemming, semantic embeddings and all other clever specialized things for you. Isn't there one?
And if no, what tools/libraries do exist in this area? To make something more sophisticated than in this post?
- philippemnoel 2y agoI would recommend you give ParadeDB pg_search a look. It's got support for tokenizers in all major languages. You can think of it as the next generation tsvector for more complex workloads. Disclaimer: I work at ParadeDB