3 ms·
> failover as STONITH (Shoot The Other Node In The Head) What functional consensus protocol doesn't mandate attempted murder? When a node becomes incoherent it
by hinkley 4y ago
> failover as STONITH (Shoot The Other Node In The Head)
What functional consensus protocol doesn't mandate attempted murder? When a node becomes incoherent it can't be relied upon to notice that it has done so and bow out gracefully. Like cancer, there is always a change that 'cell death' will fail and leave you in a pathological state.
- olluk 4y agoPerhaps the multi-master approach is the example of system where incoherent does not mean terminal illnesses.
- grogers 4y agoIf your consensus protocol requires that it is probably broken. If you can't rely on a node to shut itself down then you almost certainly can't rely on an external trigger to do it. Paxos, raft, etc work just fine as long as failures are non-byzantine. Achieving non-byzantine failures is definitely not always possible (e.g. someone hacking your server and reprogramming it to subvert the protocol) but checksums on disk and network go most of the way.
- remram 4y agoMost consensus algorithms assume some subset of possible behaviors from the misbehaving nodes. The algorithms that don't are called "Byzantine" and are a very short list (e.g. the situation where a node can lie and maliciously try to misinform other nodes about the state of the system). If you can tell that a node failed, there are usually other opportunities for circuit-breaking than shooting it, such as at the hypervisor, load-balancer, or even clients.