3 ms·
Anyone using object storage like S3 for cluster coordination/election instead?
by candiddevmike 3y ago
Anyone using object storage like S3 for cluster coordination/election instead?
- hotpotamus 3y agoI want to say that jgroups has an S3 coordination method. I came across quite a few methods while trying to set up a Keycloak cluster in Docker Swarm, but ultimately the Kubernetes DNS method worked best for my case (Swarm seems close enough that I was able to use it with no problem). I'd also note that my understanding is that Swarm uses the Raft algorithm.
- ithkuil 3y agoNot sure about S3. Iirc they relatively recently implemented consistent writes. But this article explains how to "piggyback" on stores providing consistent writes in order to implement your own little leader election Algo on top of a foundation layer https://cloud.google.com/blog/topics/developers-practitioners/implementing-leader-election-google-cloud-storage https://cloud.google.com/blog/topics/developers-practitioner...
- cweld510 3y agoI think S3 is too slow to put in your control plane’s critical path; better to use something like Redis.