4 ms·

Is there no other search database that can be persisted other than Elastic/Lucene/Solr? I get that there’s little money to be made in these things but it’s sur

Is there no other search database that can be persisted other than Elastic/Lucene/Solr? I get that there’s little money to be made in these things but it’s surprising. Seems like most full text search are relatively simple plug-ins to existing databases or in memory only.

morelisp 4y ago
Nearly a decade ago (oh god) I converted some overdesigned five node ES mess to https://github.com/mchaput/whoosh https://github.com/mchaput/whoosh. It's (obviously) not the fastest or anything, but it was more than good enough for low-dozens of GBs of mostly static data.
- faizshah 4y ago
  I tried whoosh but its way too slow, I think SQLite offers a great option (FTS5) for small data.
bratao 4y ago
Yes, there is. We moved from ES to Vespa (vespa.ai) and never looked back. WE got better results, speed and WAY lower maintenance costs. I really don't understand how underrated this project is.
- murkt 4y ago
  How do you deal with Vespa’s query language, YQL?
  - bratao 4y ago
    I was also suspicious "Great, another one that wants to reinvent SQL". But in practice it works very well, to the point of I enjoying it.
- faizshah 4y ago
  I agree, I think if they ever decide to get it in Apache the popularity will explode. Same thing happened with flink and ignite.
- atombender 4y ago
  Vespa seems like a great match for Elastic's text and vector search, but not for classic "OLTP"-style queries. For example, until very recently Vespa did not even have case-sensitive string field matching [1]; doing a strict equality query on a string field was not possible, and the authors did not seem to see why it would be useful. Vespa lacks a lot of this kind of basic search functionality, making it less general-purpose than Elasticsearch. It's clear that it's a very powerful search engine, though it also feels antiquated in many ways. It's very obvious that it's an ancient project that has been worked on by many different people throughout the years, with no cohesive vision or design, though it does seem like they're slowly cleaning things up. (The documentation used to be much worse, for one.) [1] https://github.com/vespa-engine/vespa/issues/10991 https://github.com/vespa-engine/vespa/issues/10991
david38 4y ago
Splunk is making billions on this.

morelisp 4y ago

Nearly a decade ago (oh god) I converted some overdesigned five node ES mess to https://github.com/mchaput/whoosh https://github.com/mchaput/whoosh. It's (obviously) not the fastest or anything, but it was more than good enough for low-dozens of GBs of mostly static data.

faizshah 4y ago
I tried whoosh but its way too slow, I think SQLite offers a great option (FTS5) for small data.

bratao 4y ago

Yes, there is. We moved from ES to Vespa (vespa.ai) and never looked back. WE got better results, speed and WAY lower maintenance costs. I really don't understand how underrated this project is.

murkt 4y ago
How do you deal with Vespa’s query language, YQL?
- bratao 4y ago
  I was also suspicious "Great, another one that wants to reinvent SQL". But in practice it works very well, to the point of I enjoying it.
faizshah 4y ago
I agree, I think if they ever decide to get it in Apache the popularity will explode. Same thing happened with flink and ignite.
atombender 4y ago
Vespa seems like a great match for Elastic's text and vector search, but not for classic "OLTP"-style queries. For example, until very recently Vespa did not even have case-sensitive string field matching [1]; doing a strict equality query on a string field was not possible, and the authors did not seem to see why it would be useful. Vespa lacks a lot of this kind of basic search functionality, making it less general-purpose than Elasticsearch. It's clear that it's a very powerful search engine, though it also feels antiquated in many ways. It's very obvious that it's an ancient project that has been worked on by many different people throughout the years, with no cohesive vision or design, though it does seem like they're slowly cleaning things up. (The documentation used to be much worse, for one.) [1] https://github.com/vespa-engine/vespa/issues/10991 https://github.com/vespa-engine/vespa/issues/10991

david38 4y ago

Splunk is making billions on this.