5 ms·
Luckily there are faster and smaller alternatives in Rust for the ElasticSearch - Toshi[1], Meili[2] and Sonic[3]. In the age of Rust there is no need to use JV
by xvilka 6y ago
Luckily there are faster and smaller alternatives in Rust for the ElasticSearch - Toshi[1], Meili[2] and Sonic[3]. In the age of Rust there is no need to use JVMs overhead.
[1] https://github.com/toshi-search/Toshi https://github.com/toshi-search/Toshi
[2] https://github.com/meilisearch/MeiliSearch https://github.com/meilisearch/MeiliSearch
[3] https://github.com/valeriansaliou/sonic https://github.com/valeriansaliou/sonic
- jabo 6y agoAdding Typesense to the list as an easier-to-use alternative to ElasticSearch: https://github.com/typesense/typesense https://github.com/typesense/typesense One thing to point out though is that Typesense, MeiliSearch (and Algolia) are designed for Instant Search experiences, and so hold the entire index in memory. So for petabyte scale data (like logs) it might be wasteful (and expensive) to store that size of data in memory. This is where ElasticSearch shines and of course comes with it the overhead of managing it.
- craigching 6y agoExactly, the logs use case is what we use Elasticsearch for.
- z77dj3kl 6y agoDo you really have to spam your project on every thread even remotely related?
- akshaykumar90 6y agoIf it is even remotely related, it is not spam.
- postalrat 6y agoI didn't realize rust and the jvm solve the same problem.
- whateveracct 6y agoLow-level programmers talking about "JVM overhead" betray their own lack of understanding. Rust and C and manual memory management have overhead too.
- _J_Phi_F_ 6y agoAccording to the Rust evangelists only Rust solves problems - and it solves all the problems in the world, while C/C++, Java, Go or C# just create problems.
- confiq 6y ago> https://github.com/valeriansaliou/sonic https://github.com/valeriansaliou/sonic This is actually very interesting project. Do we have some benchmark that sonic works on huge scale with lot of data?
- nanagojo 6y agoI assume you find their own benchmarks not conclusive enough? https://github.com/valeriansaliou/sonic#how-fast--lightweight-is-it https://github.com/valeriansaliou/sonic#how-fast--lightweigh... they also claim > It is used to index half a billion objects on a $5/mth 1-vCPU SSD cloud server (as of 2019)
- confiq 6y agohmm, maybe I should ask, do we have somebody who is using this on production with huge amount of data?
- confiq 6y agook, i'm stupid > Sonic is integrated in all Crisp search products on the Crisp platform. It is used to index half a billion objects on a $5/mth 1-vCPU SSD cloud server (as of 2019). Crisp users use it to search in their messages, conversations, contacts, helpdesk articles and more.
- deknos 6y agothough there would be vector as logstash/fluent replacement, there's no kibana (even a basic version) which one could use with these components.
- CameronNemo 6y agoCould honestly be a good thing. Kibana encourages admin by GUI in a way that creates a big mess of the cluster.
- koffiezet 6y agoJVM overhead is overrated. And I say that as someone who's not particularly fond of the JVM. Elasticsearch is one of those projects where the JVM is not the issue. Of all the projects you mention however, only Toshi addresses clustering, and as an experimental feature. If you're using it for logfiles, the only real alternative I know is Grafana's loki.
- _J_Phi_F_ 6y agoGood for us to be in the age of 0.01% marketshare Rust where probably 80% of the software runs on the shabby JVM. Too bad we're talking about software license here.