3 ms·

and then one day https://mobile.twitter.com/Dereklowe/status/1599035870308618241 https://mobile.twitter.com/Dereklowe/status/1599035870308618... happens and peo

by chx 4y ago

and then one day https://mobile.twitter.com/Dereklowe/status/1599035870308618241 https://mobile.twitter.com/Dereklowe/status/1599035870308618... happens and people die.

nonethewiser 4y ago
One day what happens? A person uses it to encourage topical application of a toxic material and publishes the results? How is ChatGPT enabling this? All of that is very possible without ChatGPT. The damaging part is deciding to do it.
- chx 4y ago
  They released a zero day for a security hole in the human brain. That's what ChatGPT is. The security hole is well known and described perhaps the most understandable format is the book Thinking Fast And Slow which describes, ah, if I try to explain I will surely botch but perhaps put it this way: how things that appear more credible will be deemed credible because of the "fast" processes in our brains. In this particular case, ChatGPT will write something nonsensical which people will accept more easily because of the way it is written. This is inevitable and extremely dangerous.
  - int_19h 4y ago
    Humans are still a lot better at writing something nonsensical that people will accept easily because of the way it's written. Conversely, I just ask ChatGPT to extol the virtues of leaded gasoline, and instead I got a lecture on exactly why and how it's extremely harmful.
    - _ugfj 4y ago
      > Humans are still a lot better at writing something nonsensical that people will accept easily because of the way it's written. Some are but not many. And then there's the amount. That's the crux of the matter. Have you seen that Aza Raskin interview where he posited one could ask the AI to write a thousand papers citing previous research against vaccines and then another thousand pro-vaccines? No human can do that.
moffkalast 4y ago
You know people are already injecting themselves with bleach and horse dewormer without needing an AI generated list of instructions right? People are just as good at making up convincing sounding nonsense.
- ctoth 4y ago
  > People are just as good at making up convincing sounding nonsense. Perhaps as you just did, as I can find no one actually "injecting themselves with bleach." The overall point stands: the difference between reading something dumb and doing that dumb thing is what it means to have agency. I personally don't think we should optimize the world 100% to prevent people who read something stupid from doing that stupid thing. Or, if that's the path we're going to take, maybe we should first target things like the show Ridiculousness before we start talking about AI. After all, someone might do something dumb they see on TV!
  - astrange 4y ago
    > Perhaps as you just did, as I can find no one actually "injecting themselves with bleach." Ingesting, injecting, that’s pretty similar. Nobody needs to make anything up there. https://www.justice.gov/usao-sdfl/pr/leader-genesis-ii-church-health-and-healing-who-sold-toxic-bleach-fake-miracle-cure https://www.justice.gov/usao-sdfl/pr/leader-genesis-ii-churc...
  - mrtranscendence 4y ago
    People have absolutely injected themselves with what's known as "Miracle Mineral Solution", which is essentially bleach. It's more frequently drunk, of course.

by chx 4y ago

and then one day https://mobile.twitter.com/Dereklowe/status/1599035870308618241 https://mobile.twitter.com/Dereklowe/status/1599035870308618... happens and people die.

nonethewiser 4y ago

One day what happens? A person uses it to encourage topical application of a toxic material and publishes the results? How is ChatGPT enabling this? All of that is very possible without ChatGPT. The damaging part is deciding to do it.

chx 4y ago
They released a zero day for a security hole in the human brain. That's what ChatGPT is. The security hole is well known and described perhaps the most understandable format is the book Thinking Fast And Slow which describes, ah, if I try to explain I will surely botch but perhaps put it this way: how things that appear more credible will be deemed credible because of the "fast" processes in our brains. In this particular case, ChatGPT will write something nonsensical which people will accept more easily because of the way it is written. This is inevitable and extremely dangerous.
- int_19h 4y ago
  Humans are still a lot better at writing something nonsensical that people will accept easily because of the way it's written. Conversely, I just ask ChatGPT to extol the virtues of leaded gasoline, and instead I got a lecture on exactly why and how it's extremely harmful.
  - _ugfj 4y ago
    > Humans are still a lot better at writing something nonsensical that people will accept easily because of the way it's written. Some are but not many. And then there's the amount. That's the crux of the matter. Have you seen that Aza Raskin interview where he posited one could ask the AI to write a thousand papers citing previous research against vaccines and then another thousand pro-vaccines? No human can do that.

moffkalast 4y ago

You know people are already injecting themselves with bleach and horse dewormer without needing an AI generated list of instructions right? People are just as good at making up convincing sounding nonsense.

ctoth 4y ago
> People are just as good at making up convincing sounding nonsense. Perhaps as you just did, as I can find no one actually "injecting themselves with bleach." The overall point stands: the difference between reading something dumb and doing that dumb thing is what it means to have agency. I personally don't think we should optimize the world 100% to prevent people who read something stupid from doing that stupid thing. Or, if that's the path we're going to take, maybe we should first target things like the show Ridiculousness before we start talking about AI. After all, someone might do something dumb they see on TV!
- astrange 4y ago
  > Perhaps as you just did, as I can find no one actually "injecting themselves with bleach." Ingesting, injecting, that’s pretty similar. Nobody needs to make anything up there. https://www.justice.gov/usao-sdfl/pr/leader-genesis-ii-church-health-and-healing-who-sold-toxic-bleach-fake-miracle-cure https://www.justice.gov/usao-sdfl/pr/leader-genesis-ii-churc...
- mrtranscendence 4y ago
  People have absolutely injected themselves with what's known as "Miracle Mineral Solution", which is essentially bleach. It's more frequently drunk, of course.