3 ms·

You can create an LLM to keep a check on the LLM interacting with people. This is basically what all “safety” etc models do - they work as gatekeepers for the m

You can create an LLM to keep a check on the LLM interacting with people. This is basically what all “safety” etc models do - they work as gatekeepers for the more powerful model. This is an implementation problem and not really a technical limitation. If anything, by focusing on a particular domain (like therapy), the do’s and don’ts become more clear.

sarchertech 1y ago
Sure you might be able to do that. Or it could turn out that the amount of harmful responses are so varied that trying to block all of them makes the therapy AI useless. There is a very fine line between being understanding and supportive and enabling bad behavior. I’m not confident that a team of LLMs is going to be able to walk that line consistently anytime soon. We can’t even get code generating LLMs to stop hallucinating APIs and code is a much narrower domain than therapy.
- sheepscreek 1y ago
  For what it’s worth, in my personal experience, ChatGPT 4o, DeepSeek R1, and Grok 3, to an extent, are “smarter” about human behaviour than they are at producing code. There’s likely a lot going on behind the scenes to maintain continuity (so it produces content that’s pretty consistent, at least for me on behavioural discussions), especially with ChatGPT. It’s been incredibly helpful for my personal use: brainstorming ideas, such as exploring how different scenarios might unfold. For instance, I can ask, “What are the pros and cons of choosing x over y, considering these factors?” or even, “I’m in a tough spot. X and I often argue about Z (provide some background context), and I’m struggling to express my perspective. I’m afraid…” You get the idea. GPT-4o is remarkably good at putting things in an independent and unbiased third person perspective. It’s definitely not an echo chamber for me. More often, the insights are what I might have come up with if I were observing my own life from a distance. Now some people have said “sure it’s like journaling”. I think it’s even better, like talking to your journal (ala Harry Potter, like Tom Riddle’s diary) with some level of fact checking (I’ve gotten called out) and human behavioural understanding available at your disposable.
  - sarchertech 1y ago
    I’m sure they can be very useful for things like that. Provided the user has a sophisticated understanding of the technology as you clearly do. That’s not the same as selling chat bots to vulnerable naive people who think they are talking to an intelligent “therapist”. And it’s not just code where they go off the rails. If you talk to them for a while they will very frequently end up agreeing with you if you want them to. I’ve seen this many times when using an LLM to try to learn something new or refresh my memory.

sarchertech 1y ago

Sure you might be able to do that. Or it could turn out that the amount of harmful responses are so varied that trying to block all of them makes the therapy AI useless. There is a very fine line between being understanding and supportive and enabling bad behavior. I’m not confident that a team of LLMs is going to be able to walk that line consistently anytime soon. We can’t even get code generating LLMs to stop hallucinating APIs and code is a much narrower domain than therapy.

sheepscreek 1y ago
For what it’s worth, in my personal experience, ChatGPT 4o, DeepSeek R1, and Grok 3, to an extent, are “smarter” about human behaviour than they are at producing code. There’s likely a lot going on behind the scenes to maintain continuity (so it produces content that’s pretty consistent, at least for me on behavioural discussions), especially with ChatGPT. It’s been incredibly helpful for my personal use: brainstorming ideas, such as exploring how different scenarios might unfold. For instance, I can ask, “What are the pros and cons of choosing x over y, considering these factors?” or even, “I’m in a tough spot. X and I often argue about Z (provide some background context), and I’m struggling to express my perspective. I’m afraid…” You get the idea. GPT-4o is remarkably good at putting things in an independent and unbiased third person perspective. It’s definitely not an echo chamber for me. More often, the insights are what I might have come up with if I were observing my own life from a distance. Now some people have said “sure it’s like journaling”. I think it’s even better, like talking to your journal (ala Harry Potter, like Tom Riddle’s diary) with some level of fact checking (I’ve gotten called out) and human behavioural understanding available at your disposable.
- sarchertech 1y ago
  I’m sure they can be very useful for things like that. Provided the user has a sophisticated understanding of the technology as you clearly do. That’s not the same as selling chat bots to vulnerable naive people who think they are talking to an intelligent “therapist”. And it’s not just code where they go off the rails. If you talk to them for a while they will very frequently end up agreeing with you if you want them to. I’ve seen this many times when using an LLM to try to learn something new or refresh my memory.