The only real way to deal with this is to test distributed systems. Doing so is hard, but only way to reliably know a system behaves given unpredictable failur

The only real way to deal with this is to test distributed systems. Doing so is hard, but only way to reliably know a system behaves given unpredictable failures. So learn up: - http://jepsen.io http://jepsen.io - https://github.com/Netflix/chaosmonkey https://github.com/Netflix/chaosmonkey - https://github.com/gundb/panic-server https://github.com/gundb/panic-server