3 ms·
Uh, that isn't the "O-Ring Theory" I would have expected. The Challenger failed because, while the O-Rings were within tolerances, they shouldn't have been var
by powera 11y ago
Uh, that isn't the "O-Ring Theory" I would have expected.
The Challenger failed because, while the O-Rings were within tolerances, they shouldn't have been varying at all. So because they were varying unexpectedly, they inevitably failed.
I would claim the corresponding devops theory is "measure everything, know what is measurement noise and what is user activity, and eliminate everything else before it causes an outage".
(from Wikipedia: "In one example, early tests resulted in some of the booster rocket's O-rings burning a third of the way through. These O-rings provided the gas-tight seal needed between the vertically stacked cylindrical sections that made up the solid fuel booster. NASA managers recorded this result as demonstrating that the O-rings had a "safety factor" of 3. Feynman incredulously explains the magnitude of this error: a "safety factor" refers to the practice of building an object to be capable of withstanding more force than the force to which it will conceivably be subjected. To paraphrase Feynman's example, if engineers built a bridge that could bear 3,000 pounds without any damage, even though it was never expected to bear more than 1,000 pounds in practice, the safety factor would be 3. If a 1,000 pound truck drove across the bridge and it cracked at all, even just a third of the way through a beam, the safety factor is now zero: the bridge is defective.")
- msandford 11y ago> The Challenger failed because, while the O-Rings were within tolerances, they shouldn't have been varying at all. So because they were varying unexpectedly, they inevitably failed. That's not entirely correct. The idea that "the o-rings were within tolerance" isn't right. There is effectively no tolerance on the o-ring, either it's very, very nearly perfect or there's something wrong with your design, just like the bridge. The o-rings should be getting immeasurably small amounts of wear so the idea that they were "only" burning up 1/3 is a huge red flag. Any measurable wear on them is a problem, so 1/3 of them being gone means they were perhaps 30 or 300 times over tolerance.
- powera 11y agoYes, of course. Perhaps "while the O-Rings hadn't yet catastrophically failed" would be the more accurate way of phrasing that.