3 ms·

Exactly why people turn to AI, which I think is good enough for "casual" mental health advice (the kind people can do themselves by reading self-help books or t

Exactly why people turn to AI, which I think is good enough for "casual" mental health advice (the kind people can do themselves by reading self-help books or talking with empathic friends). Arguably it's safer than talking to strangers online because now that they've been doing it for a few years, they will (or should) have plenty of safeguards, unlike people on the internet who can talk out of their ass (like me!) and give bad advice. In theory the LLM will escalate or recommend professional help if they're out of their depth.

newswasboring 15d ago
> In theory the LLM will escalate or recommend professional help if they're out of their depth. LLMs can barely identify gaps in their own software designs, and they are provably good at making software.
- duskwuff 15d ago
  LLMs are also incredibly poor at recognizing that they're "out of their depth", especially when their context is already full of their attempts to do something.
officeplant 15d ago
>In theory the LLM will escalate or recommend professional help if they're out of their depth. Given there have been multiple suicides driven by LLMs. I really doubt that.
- tt24 15d ago
  Fascinating perspective - any technology that has caused >0 deaths is a dead end and has no chance of improvement.
  - officeplant 15d ago
    I'm sure the Torment Nexus can be improved.
    - tt24 13d ago
      Thought terminating cliche.
  - pocksuppet 13d ago
    Really hot take apparently: any technology that causes people to commit suicide during therapy isn't a good therapist.
    - tt24 13d ago
      Is your claim that human therapists have caused zero suicides? I hope not for your sake - that would be a really hard one to defend
      - pocksuppet 12d ago
        Why do you think that a human therapist who causes patients to commit suicide is a good therapist? I don't understand that.
        tt24 11d ago
        I think human therapy is a good thing despite the fact that it has caused suicides.
micromacrofoot 15d ago
In practice we know that LLMs have aided in suicide, so what they should do in theory doesn't matter.
- voakbasda 15d ago
  And how many people can it be credited for saving from self harm? Probably countless more than it has harmed, if I had to bet.

newswasboring 15d ago

> In theory the LLM will escalate or recommend professional help if they're out of their depth. LLMs can barely identify gaps in their own software designs, and they are provably good at making software.

duskwuff 15d ago
LLMs are also incredibly poor at recognizing that they're "out of their depth", especially when their context is already full of their attempts to do something.

officeplant 15d ago

>In theory the LLM will escalate or recommend professional help if they're out of their depth. Given there have been multiple suicides driven by LLMs. I really doubt that.

tt24 15d ago
Fascinating perspective - any technology that has caused >0 deaths is a dead end and has no chance of improvement.
- officeplant 15d ago
  I'm sure the Torment Nexus can be improved.
  - tt24 13d ago
    Thought terminating cliche.
- pocksuppet 13d ago
  Really hot take apparently: any technology that causes people to commit suicide during therapy isn't a good therapist.
  - tt24 13d ago
    Is your claim that human therapists have caused zero suicides? I hope not for your sake - that would be a really hard one to defend
    - pocksuppet 12d ago
      Why do you think that a human therapist who causes patients to commit suicide is a good therapist? I don't understand that.
      - tt24 11d ago
        I think human therapy is a good thing despite the fact that it has caused suicides.

micromacrofoot 15d ago

In practice we know that LLMs have aided in suicide, so what they should do in theory doesn't matter.

voakbasda 15d ago
And how many people can it be credited for saving from self harm? Probably countless more than it has harmed, if I had to bet.