Except 1. It's neither a human nor a qualified therapist. 2. It is superhuman only in scale, not intelligence. 3. If they truly believed they could fly "with

Except 1. It's neither a human nor a qualified therapist. 2. It is superhuman only in scale, not intelligence. 3. If they truly believed they could fly "with every ounce of their soul", they wouldn't be seeking someone else's affirmation. 4. Even if you asked a random human, it may be immoral, but it's not illegal to answer misleadingly, random people have no legal obligation... LLMs are a statistical model based on data of random people from the internet of evil, aka - the internet. I'm not an LLM proponent but blaming LLMs for not making the world into a padded cell is just a variant of "won't somebody think of the children".