Because of human interpretation and knack for self sabotage, the sheer breadth of ways self harm can present is far greater than the ways we can imagine. This i

Because of human interpretation and knack for self sabotage, the sheer breadth of ways self harm can present is far greater than the ways we can imagine. This is why you need a psychiatrist, or many psychiatrists in order to prevent someone hurting themselves or others. And I'm sure you're perfectly aware of the many times chatgpt or another model confidently spouted bullshit as fact, so asking if something promoted self harm or is it speculation is a bit disingenuous, imo. Hallucination is not an if, but a when. You need to show some sort of statistical analysis that hallucinating is kept to a very low percentage. We are programmers, we can't do everything, or know everything, we must reach out to and include domain level experts. Anything less is simply hubris doused in irresponsibility. I'm sure there are psychiatrists that would even assist you for free. I could see many ideas from your app, as I've had similar ideas. But it all rests on the reliability of the llm.