4 ms·

We have implemented guardrails so it won't give such answers. We are currently working on doing Direct Preference Optimisation to drive the probability of givin

We have implemented guardrails so it won't give such answers. We are currently working on doing Direct Preference Optimisation to drive the probability of giving negative answers completely away. Thanks for your concern we have actually considered this and are actively working on it. Since we are just 2 guys working on it as a passion project we couldn't really onboard any psychiatrist with us for now. But we will indeed contact someone. Also out of curiosity did it promote self harm or is it your speculation?

russdpale 3y ago
Because of human interpretation and knack for self sabotage, the sheer breadth of ways self harm can present is far greater than the ways we can imagine. This is why you need a psychiatrist, or many psychiatrists in order to prevent someone hurting themselves or others. And I'm sure you're perfectly aware of the many times chatgpt or another model confidently spouted bullshit as fact, so asking if something promoted self harm or is it speculation is a bit disingenuous, imo. Hallucination is not an if, but a when. You need to show some sort of statistical analysis that hallucinating is kept to a very low percentage. We are programmers, we can't do everything, or know everything, we must reach out to and include domain level experts. Anything less is simply hubris doused in irresponsibility. I'm sure there are psychiatrists that would even assist you for free. I could see many ideas from your app, as I've had similar ideas. But it all rests on the reliability of the llm.