2 ms·
I think it's a pretty common ethics case study. Therac-25 almost seems like a meme to me these days: "What are the ethical implications in the field of softwa
by jrockway 10y ago
I think it's a pretty common ethics case study. Therac-25 almost seems like a meme to me these days:
"What are the ethical implications in the field of software engineering?"
"Therac-25."
I don't think we've gotten any better, either. I'm surprised there aren't thousands of Therac-25s killing people every day, actually. I guess the hardware engineers got better at turning off software, because I don't think software engineers got better at software engineering.
- Gibbon1 10y ago> I guess the hardware engineers got better at turning off software, because I don't think software engineers got better at software engineering. Years ago (like 25 years) I read an author discussing safety critical system. He flat out said, safety must be a primary system level design goal. Attempts to band aid it in will fail. Properly designed systems have safeties, interlocks, and monitoring subsystems to prevent software bugs from propagating to the point where people are harmed. People designing safety critical systems tend to completely distrust software.
- bipson 10y agoHuh, I think I never heard of the Therac-25. We instead talked about flight Lufthansa 2904 [1] (Airbus A320-211 Warsaw accident), also as a case of overconfident engineers (although Wikipedia mostly blames the weather report). [1] https://en.wikipedia.org/wiki/Lufthansa_Flight_2904 https://en.wikipedia.org/wiki/Lufthansa_Flight_2904