Maybe the 1985 software bug that led to massive overdoses of radiation for cancer patients: https://en.wikipedia.org/wiki/Therac-25 https://en.wikipedia.org/wik

Maybe the 1985 software bug that led to massive overdoses of radiation for cancer patients: https://en.wikipedia.org/wiki/Therac-25 https://en.wikipedia.org/wiki/Therac-25 There are also cases of airplane crashes due to software defects, blackouts, critical hospital failures, etc. I suspect the first "AI disaster" will be pretty similar: a sudden and undetected drop in software quality with life-threatening consequences. (Doesn't help that the author of the post blithely asserted that programmer-agents is a solved problem, when it very much is not). But I could see an LLM doctor/etc causing a very different kind of disaster.