Yup. I've worked at several places where there has been battery backup, diesel generators, and a a disaster recovery site with generally nice and thorough stra

Yup. I've worked at several places where there has been battery backup, diesel generators, and a a disaster recovery site with generally nice and thorough strategies for replication including really expensive "sysplex-mode" for mainframes, topped with regular contigency tests where one half of the site is shut down. And somehow, at every place, eventually something bad happened in a way that took down the applications. It could be a power outage in the exactly the wrong circuit, fluctuating power messed up exactly the wrong storage system, someone dug up exactly the wrong fiber, the fire extinguisher set off by mistake and sprayed just the wrong cabinet with water fog through a door(!) that was supposed to automatically close, the diesel generator caught fire and the backup battery had to be taken offline, etc etc. I'm not saying that you shouldn't try, but it's damn hard.