4 ms·

NOBODY USE THIS. EVER. First it’s sketch as fuck, second GPT is a guestimation engine and people are getting killed for asking it for psychological help. Someo

NOBODY USE THIS. EVER. First it’s sketch as fuck, second GPT is a guestimation engine and people are getting killed for asking it for psychological help. Someone in Belgium commit suicide to save the planet last month. I love the drive and the idea, as someone who could benefit from this, but I have to shut this down hard. As someone with significant mental health issues, and a moderate amount of experience with AI, who works with it daily, don’t mix them, please. NEVER use GPT for financial, health, legal or other advice, as it’s not meant for that. Yes, it can simplify the research process, but always verify. If you wanted to use a Language Model like this safely, you could load medical language models and ask questions about definitions, but never advice. If you’re interested, I’d love to show you the basics, and I hate to shoot down other peoples good work, but not in this case. Author: you’re probably not meaning any harm, but I have no way of knowing that. You need to do far more research, far more legal considerations, and far more footwork to make this work. Don’t be discouraged, but don’t get people killed with carelessness.

atrone 4y ago
Hey, thanks for the feedback. I'm interested in how I can use this moving forward because I have personally found my app to be helpful for getting over a breakup. My prompt is designed for Mindy to act as the "best of both worlds" between a real therapist and robot therapist, which means it will refer you to real therapy if it deems your problem too serious for a robot. I'm not sure anymore however. I don't store any data for longer than the session is active, but I know OpenAI does. Also: OpenAI knows I am using their API for this purpose. I'm really at a loss. I see the value and the harm. I'm going to have to do more thinking on this.
- mikercampbell 4y ago
  I’m sorry I came down so hard. I was thinking about it, and man - I am just so scared for people right now. But I see your love, and I want to help!! I have experience in PII and HIPPA and can see if we can address some of this stuff. I think a conclusive terms of service, less specific questions, and storing it entirely in the browser if possible, will be a solid start . My passion is from concern, not anger. I hope that comes across
  - atrone 4y ago
    Cool! Down to work on this. Let me know where to reach out. Also I've contacted my lawyer about this and it's a very grey area. We'll see where that goes.
- kebman 4y ago
  I've also used ChatGPT for "self therapy" and found out that it works reasonably well, though I would not recommend it for serious medical or psychiatric issues. I always take the feedback with a grain of salt, however, and usually when you ask such questions you are given the caveat to seek professional help. If anything, I have positive faith in that ChatGPT or GPTn will be a great tool for therapy in the future. As for the guy who killed himself, as sad as it is, I seriously doubt that ChatGPT made anything worse. With that said, the incident of course needs closer investigation to find out what advice the guy actually got. A chat AI would have specific and professionally prepared training to handle people in distress, that's why I think it is in fact better that they talk to the AI rather than some untrained friend or relative. This is of course just one aspect in how the above application is problematic, however.

atrone 4y ago

Hey, thanks for the feedback. I'm interested in how I can use this moving forward because I have personally found my app to be helpful for getting over a breakup. My prompt is designed for Mindy to act as the "best of both worlds" between a real therapist and robot therapist, which means it will refer you to real therapy if it deems your problem too serious for a robot. I'm not sure anymore however. I don't store any data for longer than the session is active, but I know OpenAI does. Also: OpenAI knows I am using their API for this purpose. I'm really at a loss. I see the value and the harm. I'm going to have to do more thinking on this.

mikercampbell 4y ago
I’m sorry I came down so hard. I was thinking about it, and man - I am just so scared for people right now. But I see your love, and I want to help!! I have experience in PII and HIPPA and can see if we can address some of this stuff. I think a conclusive terms of service, less specific questions, and storing it entirely in the browser if possible, will be a solid start . My passion is from concern, not anger. I hope that comes across
- atrone 4y ago
  Cool! Down to work on this. Let me know where to reach out. Also I've contacted my lawyer about this and it's a very grey area. We'll see where that goes.
kebman 4y ago
I've also used ChatGPT for "self therapy" and found out that it works reasonably well, though I would not recommend it for serious medical or psychiatric issues. I always take the feedback with a grain of salt, however, and usually when you ask such questions you are given the caveat to seek professional help. If anything, I have positive faith in that ChatGPT or GPTn will be a great tool for therapy in the future. As for the guy who killed himself, as sad as it is, I seriously doubt that ChatGPT made anything worse. With that said, the incident of course needs closer investigation to find out what advice the guy actually got. A chat AI would have specific and professionally prepared training to handle people in distress, that's why I think it is in fact better that they talk to the AI rather than some untrained friend or relative. This is of course just one aspect in how the above application is problematic, however.