3 ms·
In this case, thankfully, the patient was "fake". But let's pretend for a moment that a "mental health chat bot" really did tell an actual patient to kill thems
by 1f60c 6y ago
In this case, thankfully, the patient was "fake". But let's pretend for a moment that a "mental health chat bot" really did tell an actual patient to kill themselves, and they did.
Who would be responsible? It would be criminally negligent, of course, but it feels like something worse, much worse.
The only word I can think of is torture.
- fluxinflex 6y agoThis is similar to a self-driving car having to decide who should die in case of an accident - children on the street or grandparents on the sidewalk (for example). This is discussed from a philosophical point of view on Arte[1] (french with english subtitles). Specifically in form of the Trolley Problem[2]. What I see as a bigger problem is that since AIs are so complex, there is simple way to understand why the AI decided the way it did in a particular situation. So the question becomes are we willing to accept AI deciding over life and death and in addition, do we accept that we're not able to decipher why AI decide how it decided? [1]=https://www.arte.tv/en/videos/098794-001-A/how-to-solve-a-moral-dilemma/ https://www.arte.tv/en/videos/098794-001-A/how-to-solve-a-mo... [2]=https://en.wikipedia.org/wiki/Trolley_problem https://en.wikipedia.org/wiki/Trolley_problem
- siltpotato 6y agoWhat's the legal precedent for safety critical systems?