5 ms·

Does anyone have experience running Elasticsearch as a kubernetes deployment? Can you just spin up some big-RAM containers attached to persisted volumes? Elast

Does anyone have experience running Elasticsearch as a kubernetes deployment? Can you just spin up some big-RAM containers attached to persisted volumes? Elastic Co. seems to have an offering specialized for k8s: https://www.elastic.co/elastic-cloud-kubernetes https://www.elastic.co/elastic-cloud-kubernetes but I can't understand what it does exactly. Our data is not crazy-big and it doesn't need to be super performant, but for operational simplicity I'd like to deploy as part of the production cluster like all our other app containers rather than some "special" type of container.

kuhsaft 7y ago
I found Elastic Cloud on K8s to be the best way to deploy and manage Elastic clusters on Kubernetes so far. https://www.elastic.co/guide/en/cloud-on-k8s/current/index.html https://www.elastic.co/guide/en/cloud-on-k8s/current/index.h...
kuhsaft 7y ago
Elastic Cloud on K8s is an operator that uses CRDs to define Elastic resources. The operator manages and deploys the appropriate deployments and statefulsets for the resource. It handles upgrades of the Elastic services as well. The operator pattern creates a more declarative way of provisioning Elastic resources.
zegl 7y ago
Yep, I'm running ES in a StatefulSet. It works nicely out of the box using headless Services for node-to-node discovery, and by using a custom preStop hook, to make sure that the cluster wouldn't become RED after the node shuts down.
- pm90 7y ago
  Does the Prestop hook just leave the cluster instead of dying and waiting for reconciliation?
  - zegl 7y ago
    It's blocking forever if the cluster isn't GREEN.
_jsnk 7y ago
I was successful in using this guide: https://aws.amazon.com/blogs/opensource/open-distro-for-elasticsearch-on-kubernetes/ https://aws.amazon.com/blogs/opensource/open-distro-for-elas... to setup Amazon's Open Distro version of Elasticsearch/Kibana. I had to modify it to work with Elasticsearch 7.x (which corresponds to Open Distro 1.x). This guide was written for Elasticsearch 6.x (which corresponds to Open Distro 0.x).

kuhsaft 7y ago

I found Elastic Cloud on K8s to be the best way to deploy and manage Elastic clusters on Kubernetes so far. https://www.elastic.co/guide/en/cloud-on-k8s/current/index.html https://www.elastic.co/guide/en/cloud-on-k8s/current/index.h...

kuhsaft 7y ago

Elastic Cloud on K8s is an operator that uses CRDs to define Elastic resources. The operator manages and deploys the appropriate deployments and statefulsets for the resource. It handles upgrades of the Elastic services as well. The operator pattern creates a more declarative way of provisioning Elastic resources.

zegl 7y ago

Yep, I'm running ES in a StatefulSet. It works nicely out of the box using headless Services for node-to-node discovery, and by using a custom preStop hook, to make sure that the cluster wouldn't become RED after the node shuts down.

pm90 7y ago
Does the Prestop hook just leave the cluster instead of dying and waiting for reconciliation?
- zegl 7y ago
  It's blocking forever if the cluster isn't GREEN.

_jsnk 7y ago

I was successful in using this guide: https://aws.amazon.com/blogs/opensource/open-distro-for-elasticsearch-on-kubernetes/ https://aws.amazon.com/blogs/opensource/open-distro-for-elas... to setup Amazon's Open Distro version of Elasticsearch/Kibana. I had to modify it to work with Elasticsearch 7.x (which corresponds to Open Distro 1.x). This guide was written for Elasticsearch 6.x (which corresponds to Open Distro 0.x).