3 ms·
If the runbooks are this clear (and the monitoring this accurate), you don't really need an on call engineer at all tbh. Just have an automated system look at t
by WJW 3y ago
If the runbooks are this clear (and the monitoring this accurate), you don't really need an on call engineer at all tbh. Just have an automated system look at the error graph and roll back to the previous release if the errors go up too much. There's a bunch of blog posts out there of companies that already do this.
- midasuni 3y agoIm not sure why a new version was rolled out by a team who weren’t monitoring it for at least the next 5 minutes.
- pjc50 3y agoIndeed. If you have a detailed, unambiguous, exact process that can resolve issues without a human having to make a judgement call .. why are you giving it to a human to execute? The human's role in an ops situation is like that of the "safety driver" in self driving cars: do nothing most of the time, deal with emergencies, and take the blame for the failure of the system.