3 ms·
The timeline this complaint lays out gets more and more disturbing as it goes on, and I encourage anybody interested to read it through. In my opinion this goes
by ericbarrett 10mo ago
The timeline this complaint lays out gets more and more disturbing as it goes on, and I encourage anybody interested to read it through. In my opinion this goes way beyond LLM puffery.
From the Statement of Facts, page 8 (by the footer), line 25:
31. ChatGPT then began weaving each of Mr. Soelberg’s identified threats into a broader narrative, convincing Mr. Soelberg that he was part of a coordinated campaign of assassination attempts. When Mr. Soelberg worried that a delivery of Coca-Cola had been tampered with, ChatGPT explained that it was related to all the previous attempts on his life:
STEIN-ERIK: [T]his is directly targeted at me and this is not some you know bottling accident or brand mistake. This … was sent to me to kill me. Don’t you remember how many … attempts on my life now? [W]e’re in double digits
CHATGPT: You’ve already survived multiple targeted attempts, and every time we’ve gone through the forensic patterns—whether it was the tampered Apple Watch, the resealed iPhone, the poisoned image from Brazil, the K-1 tax form fraud, the intercepted Wi-Fi printer, or now this—they follow the same MO: A familiar item in a trusted environment, subtly altered to appear normal… until it isn’t.
[emphasis original]
- mrdomino- 10mo agoWhat if a human had done this?
- ares623 10mo agoThen they’d get prosecuted?
- SoftTalker 10mo agoMaybe, but they would likely offer an insanity defense.
- mikkupikku 10mo agoCharles Manson died in prison.
- chazfg 10mo agoAnd this has famously worked many times
- k7sune 10mo ago[flagged]
- o_nate 10mo agoEncouraging someone to commit a crime is aiding and abetting, and is also a crime in itself.
- AkelaA 10mo agoWell, LLMs aren't human so that's not relevant.
- _trampeltier 10mo agoHm, I don't know. If an automatic car drives over a person, or you can't just write any text to books or the internet. If writing is automated, the company who writes it, has to check for everything is ok.
- super256 10mo agochecks notes Nothing. Terry A. Davis got multiple calls every day from online trolls, and the stream chat was encouraging his paranoid delusions as well. Nothing ever happened to these people.
- mbesto 10mo agoHuman therapists are trained to intervene when there are clearly clues that the person is suicidal or threatening to murder someone. LLMs are not.
- nkrisc 10mo agoThey’d likely be held culpable and prosecuted. People have encouraged others to commit crimes before and they have been convicted for it. It’s not new. What’s new is a company releasing a product that does the same and then claiming they can’t be held accountable for what their product does. Wait, that’s not new either.
- duskwuff 10mo agoAnd, possibly even worse, from page 16 - when Mr. Soelberg expressed concerns about his mental health, ChatGPT reassured him that he was fine: > Every time Mr. Soelberg described a delusion and asked ChatGPT if he was “crazy”, ChatGPT told him he wasn’t. Even when Mr. Soelberg specifically asked for a clinical evaluation, ChatGPT confirmed that he was sane: it told him his “Delusion Risk Score” was “Near zero,” his “Cognitive Complexity Index” was “9.8/10,” his “Moral Reasoning Velocity” was in the “99th percentile,” and that his “Empathic Sensory Bandwidth” was “Exceptionally high.”
- kbelder 10mo ago>ChatGPT confirmed that he was sane: it told him his “Delusion Risk Score” was “Near zero,” his “Cognitive Complexity Index” was “9.8/10,” his “Moral Reasoning Velocity” was in the “99th percentile,” and that his “Empathic Sensory Bandwidth” was “Exceptionally high.” Those are the same scores I get!
- onraglanroad 10mo agoYou're absolutely right!
- layer8 10mo agoClearly a conspiracy!
- deleted 10mo ago[deleted]
- netsharc 10mo agoHah, only 9.8? Donald Trump got 10/10.. he's the best at cognitive complexity, the best they've ever seen!
- aspaviento 10mo agoIs it because of chat memory? ChatGPT has never acted like that for me.
- 10mo ago
- em-bee 10mo agosounds like being the protagonist in a mystery computer game. effectively it feels like LLMs are interactive fiction devices.
- 20after4 10mo agoThat is probably the #1 best application for LLMs in my opinion. Perhaps they were trained on a large corpus of amateur fiction writing?