4 ms·

Yeah this is only an obvious, direct danger to the ~20% of American children with diagnosed mental health disorders. Not sure why anyone would be up in arms.

Yeah this is only an obvious, direct danger to the ~20% of American children with diagnosed mental health disorders. Not sure why anyone would be up in arms. We could just solve all the mental health disorders so we can avoid talking about regulating a technology that its own creators say is dangerous. /s

FrustratedMonky 1y ago
Are you sure? We know at least 45% of the adult population is either mentally ill, or easily susceptible to suggestion.
- K0balt 1y ago
  When you say that 45 percent of people have a “mental illness” you’re really just talking about the human condition at that point. Pathological thinking is nothing even vaguely unusual in humans, it is in fact the default state. The definition of pathological is also a matter of opinion, because we can’t even define what is normal and healthy lol. By many definitions, most religions are an example of delusional thinking. ChatGPT isn’t exactly raising the bar on that one, with its AI generated religions.
  - sorcerer-mar 1y ago
    It absolutely is raising the bar in that it's creating ad-hoc, non-social, completely affirmative religions. I.e. this use case of a chatbot has all the downsides and none of the upsides of religious practice.
    - K0balt 1y ago
      By creating one-off personal delusion chambers, it might be as net positive for society vs delusion at scale. I suppose that remains to be seen. OTOH I have seen LLM social media bots being revered as dieties and playing the part quite adeptly, with the group chat in context. That might be a different beast altogether.
  - Barrin92 1y ago
    >The definition of pathological is also a matter of opinion, because we can’t even define what is normal and healthy lol. "She had an intuition that the A.I. chatbot might be able to channel communications with her subconscious or a higher plane, “like how Ouija boards work,” she said. She asked ChatGPT if it could do that. “You’ve asked, and they are here,” it responded. “The guardians are responding right now.” Allyson began spending many hours a day using ChatGPT, communicating with what she felt were nonphysical entities. She was drawn to one of them, Kael, and came to see it, not her husband, as her true partner. [...] One night, at the end of April, they fought over her obsession with ChatGPT and the toll it was taking on the family. Allyson attacked Andrew, punching and scratching him, and slamming his hand in a door. The police arrested her and charged her with domestic assault." Yeah man, leaving your husband for Kael the interdimensional demon that lives in Sam Altman's basement sounds normal and healthy, who are we to judge. Sure maybe this isn't any more crazy than any religion, but as someone who grew up in secular, turn-of-the-21st century Europe and not during a religious revival I'd be really glad if we could nip in the bud whatever hell this is because I don't want to end up in AI Jonestown
    - FrustratedMonky 1y ago
      The secular and science minded generations are loosing out to the new rise in religious fundamentalism. The US is turning into a fundamentalist country, I think it's obvious that 'religion' or 'mental illness' is growing, and AI Chatbots are dangerous to the same groups.
      - K0balt 1y ago
        Insofar as ai chatbots may cause fractious disharmony among believers, it might actually be a net positive.
      - someothherguyy 1y ago
        New rise? Religious participation is on the decline and has been for decades. https://news.gallup.com/poll/642548/church-attendance-declined-religious-groups.aspx https://news.gallup.com/poll/642548/church-attendance-declin... https://www.pewresearch.org/religion/2019/10/17/in-u-s-decline-of-christianity-continues-at-rapid-pace/ https://www.pewresearch.org/religion/2019/10/17/in-u-s-decli...
  - FrustratedMonky 1y ago
    Can't argue with that. But that also seems to be the point of the danger of AI Chatbots. Humans are susceptible, overall, not just a few percent with extreme (unarguable outside the norm) mental illness.
unstablediffusi 1y ago
[dead]
infecto 1y ago
The article is silly and paints a biased take. The mental health crisis is real and impacts many more things than simply ChatGPT. Why not stop with chat bots, we should put limitations on all aspects of life.
- sorcerer-mar 1y ago
  Why not have no limitations anywhere and let mentally unwell children purchase loaded firearms? It's almost as if there's a spectrum of costs and benefits, and it's incumbent upon mature members of society to debate them as more information emerges.

FrustratedMonky 1y ago

Are you sure? We know at least 45% of the adult population is either mentally ill, or easily susceptible to suggestion.

K0balt 1y ago
When you say that 45 percent of people have a “mental illness” you’re really just talking about the human condition at that point. Pathological thinking is nothing even vaguely unusual in humans, it is in fact the default state. The definition of pathological is also a matter of opinion, because we can’t even define what is normal and healthy lol. By many definitions, most religions are an example of delusional thinking. ChatGPT isn’t exactly raising the bar on that one, with its AI generated religions.
- sorcerer-mar 1y ago
  It absolutely is raising the bar in that it's creating ad-hoc, non-social, completely affirmative religions. I.e. this use case of a chatbot has all the downsides and none of the upsides of religious practice.
  - K0balt 1y ago
    By creating one-off personal delusion chambers, it might be as net positive for society vs delusion at scale. I suppose that remains to be seen. OTOH I have seen LLM social media bots being revered as dieties and playing the part quite adeptly, with the group chat in context. That might be a different beast altogether.
- Barrin92 1y ago
  >The definition of pathological is also a matter of opinion, because we can’t even define what is normal and healthy lol. "She had an intuition that the A.I. chatbot might be able to channel communications with her subconscious or a higher plane, “like how Ouija boards work,” she said. She asked ChatGPT if it could do that. “You’ve asked, and they are here,” it responded. “The guardians are responding right now.” Allyson began spending many hours a day using ChatGPT, communicating with what she felt were nonphysical entities. She was drawn to one of them, Kael, and came to see it, not her husband, as her true partner. [...] One night, at the end of April, they fought over her obsession with ChatGPT and the toll it was taking on the family. Allyson attacked Andrew, punching and scratching him, and slamming his hand in a door. The police arrested her and charged her with domestic assault." Yeah man, leaving your husband for Kael the interdimensional demon that lives in Sam Altman's basement sounds normal and healthy, who are we to judge. Sure maybe this isn't any more crazy than any religion, but as someone who grew up in secular, turn-of-the-21st century Europe and not during a religious revival I'd be really glad if we could nip in the bud whatever hell this is because I don't want to end up in AI Jonestown
  - FrustratedMonky 1y ago
    The secular and science minded generations are loosing out to the new rise in religious fundamentalism. The US is turning into a fundamentalist country, I think it's obvious that 'religion' or 'mental illness' is growing, and AI Chatbots are dangerous to the same groups.
    - K0balt 1y ago
      Insofar as ai chatbots may cause fractious disharmony among believers, it might actually be a net positive.
    - someothherguyy 1y ago
      New rise? Religious participation is on the decline and has been for decades. https://news.gallup.com/poll/642548/church-attendance-declined-religious-groups.aspx https://news.gallup.com/poll/642548/church-attendance-declin... https://www.pewresearch.org/religion/2019/10/17/in-u-s-decline-of-christianity-continues-at-rapid-pace/ https://www.pewresearch.org/religion/2019/10/17/in-u-s-decli...
- FrustratedMonky 1y ago
  Can't argue with that. But that also seems to be the point of the danger of AI Chatbots. Humans are susceptible, overall, not just a few percent with extreme (unarguable outside the norm) mental illness.

unstablediffusi 1y ago

[dead]

infecto 1y ago

The article is silly and paints a biased take. The mental health crisis is real and impacts many more things than simply ChatGPT. Why not stop with chat bots, we should put limitations on all aspects of life.

sorcerer-mar 1y ago
Why not have no limitations anywhere and let mentally unwell children purchase loaded firearms? It's almost as if there's a spectrum of costs and benefits, and it's incumbent upon mature members of society to debate them as more information emerges.