They built chaos monkey - software agents that randomly go through all their infrastructure on aws and randomly take things down. Network jitter, computer hangs

They built chaos monkey - software agents that randomly go through all their infrastructure on aws and randomly take things down. Network jitter, computer hangs, removing drives, and taking down availability zones. They do that to themselves so that when it actually happens, they are prepared and the end user (almost) never sees it.