3 ms·
> I get the desire to troubleshoot but priority 0 is make the system functional for users again, literally everything else can wait. What numbers went into thi
by kqr 3y ago
> I get the desire to troubleshoot but priority 0 is make the system functional for users again, literally everything else can wait.
What numbers went into this calculation, to get such an extreme result as concluding that getting it up again is always the first priority?
When I tried to estimate the cost and benefit, I have been surprised to make the opposite conclusion multiple times. We ended up essentially in the situation of "Yeah, sure, you can reproduce the outage in production. Learn as much as you possibly can and restore service after an hour."
This is in fact the reason I prefer to keep some margin in the SLO budget -- it makes it easier to allow troubleshooting an outage in the hot path, and it frontloads some of that difficult decision.