We had a server that was failing intermittently at about the same time of day, around 3am. Looked like a power failure from the logs but there was no problems

We had a server that was failing intermittently at about the same time of day, around 3am. Looked like a power failure from the logs but there was no problems with other servers and this server was on a dedicated circuit that was power backed up and the server had a UPS attached. So one of my team volunteered to stay and watch the server. Around 3am, one of the custodians buzzes himself into the secure server room that has limited access, at the time only 3 of us on the IT team, our head of Regulatory and the CFO, were supposed to have access. The custodian walks over to the server, says hi to Chris and proceeds to unplug the server’s UPS from the bright orange socket panel and plug in his vacuum cleaner. He then starts to vacuum the raised floor in our air filtered server room. The failure was intermittent because sometimes he finished vacuuming before the UPS ran out. Apparently our facilities manager considered herself and her staff exempt from our corporate security policies. She also told the contract custodian to “just unplug something if they didn’t have the courtesy to leave you a free plug”.