4 ms·
You and your team's resolve and success in tacking these bugs is awesome. It's interesting to read about some of the relatively "unusual" choices VoltDB has ma
by heavenlyhash 10y ago
You and your team's resolve and success in tacking these bugs is awesome.
It's interesting to read about some of the relatively "unusual" choices VoltDB has made as well. Like this one:
> network partitions cause minority nodes to shut down permanently; operator intervention is required to restore full service
...combined with requiring majorities of current rather than original clusters to continue. This is, for human operational interactions, really interesting. There's a big history of self-healing systems getting a little carried away and masking or sometimes even triggering bigger issues. Making signoff to rejoin nodes a required operation seems like it makes a whole category of "flapping" problems a non-issue. Kudos for making these "unusual" choices; this is a great horizon to explore :)
- jhugg 10y agoWe have some users who have automated rejoin. This might actually make sense in the cloud, where you just spin up another pristine instance. Personally, when a node fails, I still want to try to understand why before I take the next operational step. Thanks for your words, BTW.