3 ms·
I like the idea of killing it and moving on without paging someone at 2AM in the middle of the night. Ideally that goes into an async queue of issues though an
by lamontcg 5y ago
I like the idea of killing it and moving on without paging someone at 2AM in the middle of the night.
Ideally that goes into an async queue of issues though and someone finds the root cause and that goes into a queue of issues to fix, which is actually burned down.
I suspect what is happening more often is that the whole stack has so many levels and the SREs responsible for it all don't have the visibility into the stack they need to debug it all, so they use their SLOs as a club to ignore issues as long as they're meeting their metrics until it becomes a firefighting drill.
A pile of cargo culted best practices and SLOs replacing hands on debugging.