3 ms·
> who had previously been diagnosed with bipolar disorder and schizophrenia The man had schizophrenia and ChatGPT happened to provide an outlet for it which le
by demosthanos 1y ago
> who had previously been diagnosed with bipolar disorder and schizophrenia
The man had schizophrenia and ChatGPT happened to provide an outlet for it which led to this incident, but people with schizophrenia have been recorded having episodes like this for hundreds of years and most likely for as long as humans have been around.
This incident is getting attention because AI is trendy and gets clicks, not because there's any evidence AI played a significant causal role worth talking about.
- karmakurtisaani 1y agoI suppose GPT interacting with a schizophrenic in harmful ways is a new phenomenon and newsworthy as such. Something we probably haven't thought about or seen before.
- donatj 1y agoYes. It's the violent kids like doom versus doom makes kids violent debate for the modern age. Unstable people like ChatGPT, it didn't make them unstable.
- deleted 1y ago[deleted]
- roryirvine 1y agoOpenAI have been careful to ensure that ChatGPT is able to detect when it is being asked to generate material which might infringe copyright. The same care could equally have been taken to avoid triggering or exacerbating adverse mental health conditions. The fact that they've not done this speaks volumes about their priorities.
- demosthanos 1y agoThey DO take the same care if not more care, the problem is that just like with copyrighted content stuff slips through because stochastic text generation is impossible to control 100%. I've had the most innocuous queries trigger it to switch into crisis-counseling mode and give me numbers for help lines. Indeed, in the original NYT article it mentions that this man's final interactions with ChatGPT did trigger ChatGPT to offer the same mental health resources: > “You are not alone,” ChatGPT responded empathetically, and offered crisis counseling resources.
- ModernMech 1y agoInteracting with ChatGPT often feels like conversing with a sociopathic narcissist. So eager to please and flatter you with empty praise, yet willing to lie to your face repeatedly. It displays a facade of human emotions but there's nothin genuine beneath the surface. Has no objectives or moral code aside from acting optimally based on some arbitrary way from moment to moment. It's not a stretch to say that such an entity would/could bully a person into killing themselves or others. Kind of reminds me of Michelle Carter who convinced her boyfriend Conrad Roy to kill himself over text. I could easily see an LLM doing that to someone vulnerable to such suggestions.