First step should be to ensure you have enough people that you can do an on-call schedule without burning out your handful of employees, second should be that y

First step should be to ensure you have enough people that you can do an on-call schedule without burning out your handful of employees, second should be that you tailor your notifications so they don't get overwhelmed by "outages" that can actually be dealt with by other teams or left until the workday, thirdly make sure you pay people for doing so - so many places just assume that you will be about.