4 ms·
The better question, if you need advanced ES functionality, you don't want to manage it yourself, and AWS's offering isn't up to par, why not just use ElasticCo
by scarface74 7y ago
The better question, if you need advanced ES functionality, you don't want to manage it yourself, and AWS's offering isn't up to par, why not just use ElasticCo's managed version that also runs on AWS?
- hkchad 7y agoFor us it was roughly 2x the cost for the same instance sizes. Granted you get a lot more functionality but in our case we didn't need it so it didn't make sense for us to stay on elastic.co. I've been running 15ish ES domains on AWS (multiple regions) for the past 3 years. Our API is microservices based so we split up our elasticsearch clusters so we could scale each microservice independently. Yes it's a lot to manage but blue-green's are quicker with the smaller domains and once you automate snapshots and index cleanup it's not all that bad.
- mrkurt 7y agoThat's really the crux of why the AWS offering is "meh". It just needs to be good enough because they don't need to make any extra margin on it. elastic.co has to make money in addition to channeling money Amazon's way.
- bifrost 7y agoThat probably will eventually be what most people do if they keep running into this.
- inssein 7y agoElasticCo's offering is no better, and has its own shortcomings. The biggest shortcoming is its actually not multi-az. We were down 3 times in 2018, and unfortunately had to switch to AWS ESS. Majority of their outages were also faults of their load balancer. We've had a few of the problems described here, but so far its better then being down.
- webo 7y agoThey don't even do multi-node for node sizes smaller than 58gb RAM. Dedicated master is not available until the cluster size at least 6 nodes of 58gb RAM. Multi-master is not available. I'm not sure if this is based on research or optimal configuration size, but it seems very expensive to get a 3-node cluster going on ElasticCo. Does anybody have experience with compose? (https://compose.com/databases/elasticsearch https://compose.com/databases/elasticsearch)
- dangoldin 7y agoThere's also https://www.instaclustr.com https://www.instaclustr.com We don't use them but had a pretty in depth conversation with them about Kafka and they seemed sharp.
- etxm 7y agoElastic Cloud is a train wreck. We found a bug in their Web UI that caused the RAM slider to slide but not change the value it submitted. We tried to upgrade the RAM to the max, but the field defaults to smallest. Slider moved, but value didn’t change. Upgraded a 192GB cluster to 1GB. Shit blew up. Took three days for support to respond.
- psaux 7y agoFully agree. Rather than digressing, change the way you operate, or adhere to standards. There is no magic box for all your asks, no cloud company does this. AWS is pretty darn good with customers IMHO. Companies have to trade off stability, elasticity, features. This is coming from someone who has managed a billion users, and has had to punt features for the other 2.