3 ms·
To add to that, Netflix has open sourced a tool called Chaos Monkey which randomly terminates production instances so that you can be sure that your overall sys
by input_sh 6y ago
To add to that, Netflix has open sourced a tool called Chaos Monkey which randomly terminates production instances so that you can be sure that your overall system is resilient to instance failures.
- brazzy 6y agoI don't think that would have ever provoked this error mode, though.
- adrianN 6y agoIt might have prevented this failure by killing stale HAProxy instances...
- harpratap 6y agoIt would have. Their haproxy-server-state-management also comes under the scope of Chaos testing. Which was failing but they never set up alerts for it. So they could have seen that their chaos engine killed this process but they never got notified.