3 ms·
Hard agree. They clearly were more interested in making clear that there's not a systemic problem in how GCP's operators manage the platform, which read strongl
by rezonant 2y ago
Hard agree. They clearly were more interested in making clear that there's not a systemic problem in how GCP's operators manage the platform, which read strongly and alarmingly that there is a systemic problem in how GCP's operators manage the platform. The lack of the common sense measures you outline in their postmortem just tells me that they aren't doing anything to fix it.
- ok_dad 2y ago“There’s no systemic problem.” Meanwhile, the operators were allowed to leave a parameter blank and the default was to set a deletion time bomb. Not systemic my butt! That’s a process failure, and every process failure like this is a systemic problem because the system shouldn’t allow a stupid error like this.
- joshuamorton 2y agoIf you're arguing that that was the systemic problem, then it's been fully fixed, as the manual operation was removed and so validation can no longer be bypassed.
- rezonant 2y agoI think you glossed over the importance of the term process failure. The idea is that this one particular form missing the appropriate care is indicative of a wider lack of discipline amongst the engineers building it. Definitionally, you cannot solve a process problem by fixing a specific bug.
- joshuamorton 2y ago"we removed the system that can enable a process failure" fixes the process failure. I didn't misunderstand anything.
- cowboylowrez 2y agojoshua nails it. companies do not do root cause anymore. its just the great enshitification, google edition.