This reminds me a bit of FMEA (Failure Mode and Effects Analysis) [1] which is used heavily by the medical, automotive, and aerospace industries. Basically you

This reminds me a bit of FMEA (Failure Mode and Effects Analysis) [1] which is used heavily by the medical, automotive, and aerospace industries. Basically you try to think of all the ways that a device or process will fail, what the hazards are from those failures, and how easy it is to detect them. Then based on the risks you've uncovered, you try to mitigate the worst ones (high likelihood, low detectability, worst outcomes - e.g. death). [1] https://en.wikipedia.org/wiki/Failure_mode_and_effects_analysis https://en.wikipedia.org/wiki/Failure_mode_and_effects_analy...