3 ms·
Every couple of weeks, I or a colleague wander into our bijou data centre. We turn the power off. The UPSs beep for 10 seconds and the genny fires up. A coup
by gerdesj 5y ago
Every couple of weeks, I or a colleague wander into our bijou data centre. We turn the power off. The UPSs beep for 10 seconds and the genny fires up. A couple of SMSs land on several mobiles and a Teams channel gets notified. Icinga2 notes the power is up but provided by the genny.
I particularly like to do this when showing someone around. You whitter on about power and then you swiftly turn the key on the distribution panel and it makes a satisfying clunk. The status lights switch around and the UPSs start beeping. Then they stop. There is a barely perceptible hum from the genny in the boiler room, three walls (one of them a firewall in the traditional sense) away. It is extremely satisfying to do and customers appreciate it - they have all jumped a bit when they first see it. The UPSs obviously (monitored and fortnightly tested) have enough runtime to switch back if something fails on the genny.
At a second location there is just enough IT gear to run my company for a while. Replication via Veeam - 'nuff said.
Every couple of weeks, Veeam fires up a small part of my company's IT from backups/replicas at the second location. It runs some scripts which tests some functionality and sends out some status reports via email.
I still worry about business continuity. There is way more to it than just backups. However, get backups sorted out first. Nine months back a customer had a fire on the production floor. They are still running out of our place, 50 miles away. We set up offsite backups to our place only the week before: "There but for the Grace of God, go I" etc etc. I had them up and running inside three hours from a standing start. Rather lucky there really - they have a functioning business and I have a success story rather than a potential lawsuit from an ex-customer's liquidators trying to claw back some loot.