Not only that, but you probably need follow the sun if you want <30 minute response time. Given a system that collects minute-based metrics, it generally takes

Not only that, but you probably need follow the sun if you want <30 minute response time. Given a system that collects minute-based metrics, it generally takes around 5-10 minutes to generate an alert. Another 5-10 minutes for the person to get to their computer unless it's already in their hand (what if you get unlucky and on-call was taking a shower or using the toilet?). After that, another 5-10 minutes to see what's going on with the system. After all that, it usually takes some more minutes to actually fix the problem. Dropbox has a nice article on all the changes they made to streamline incidence response https://dropbox.tech/infrastructure/lessons-learned-in-incident-management https://dropbox.tech/infrastructure/lessons-learned-in-incid...