5 ms·

How is this specific to 4o? This can happen with any model. See how people acted after Character.AI essentially removed their AI "partners" after a server reset

How is this specific to 4o? This can happen with any model. See how people acted after Character.AI essentially removed their AI "partners" after a server reset. They actually used DeepSeek before which didn't have the same limitations as American models, especially being open weight means you can fine tune it to be as lovey dovey as your heart desires.

oidar 9mo ago
From the subreddit I linked in another comment, there did seem to be some "magic" that 4o had for these kinds of "relationships". I'm not sure how much of it is placebo, but there does seem to be a strong preference in that user group.
- satvikpendem 9mo ago
  It probably is placebo. Character AI for example used DeepSeek and I'm sure many grew attachments to that model. Ultimately though I don't even get it, models lose context very quickly so it's hard to have long running conversations with them, as well as talking very sycophanticly to you. I guess this is fixed due to implementing a good harness and memories, which is what these companies did I assume.
  - Griffinsauce 9mo ago
    > as well as talking very sycophanticly to you. That's apparently a feature to a significant amount of people..
- rtkwe 9mo ago
  4o was very sycophantic so was very willing to play along with and validate the users roleplay. OpenAI even noticed enough to talk about it in a blog: https://openai.com/index/sycophancy-in-gpt-4o/ https://openai.com/index/sycophancy-in-gpt-4o/
  - co_king_3 9mo ago
    > OpenAI even noticed enough to talk about it in a blog That's one way of interpreting things...
    - rtkwe 9mo ago
      What do you even mean by this.
      - co_king_3 9mo ago
        I suspect that OpenAI knew that their product was addictive, potentially dialed up the addictiveness as a business strategy, and is playing dumb about the whole thing.
        rtkwe 9mo ago
        I think they say as much in the blog post, essentially "we were tuning for use but way over shot the mark and now people are dating out model".
        co_king_3 9mo ago
        I don't believe them.
        satvikpendem 9mo ago
        Then why would they have toned it down in future releases? If they really wanted to make it addictive they'd have turned it up, like social media companies do with their algorithms.
        rtkwe 9mo ago
        They've definitely acted like it so I'm not sure what else I can give you. Look at the GPT5 reactions to poeple trying to continue their 'relationships' after the forced upgrade: https://www.reddit.com/r/MyBoyfriendIsAI/comments/1qx3jux/what_the_hell_is_wrong_with_gpt_wow_this_is_awful/ https://www.reddit.com/r/MyBoyfriendIsAI/comments/1qx3jux/wh... That's an actively harsh response, pushing these people away from the idea GPT is in a relationship with them. So even if the initial tune was meant to increase the attach and retention rate their actions show they don't like the way it turned out to influence people who were using it as a friend/lover bot.
odyssey7 9mo ago
It’s great marketing though
einpoklum 9mo ago
I can't believe they would stoop so low as this kind of character assassination.
roywiggins 9mo ago
One version of 4o was so sycophantic that it had to be rolled back, so there is some evidence that 4o specifically has a problem with this. https://openai.com/index/sycophancy-in-gpt-4o/ https://openai.com/index/sycophancy-in-gpt-4o/
rtkwe 9mo ago
After 4o they put in more safeguard reactions to the user attempting the kind of (lets be generous here) romantic roleplay that got a lot of people really invested in their AI "friends/partners". ex: https://www.reddit.com/r/MyBoyfriendIsAI/comments/1qx3jux/what_the_hell_is_wrong_with_gpt_wow_this_is_awful/ https://www.reddit.com/r/MyBoyfriendIsAI/comments/1qx3jux/wh...
JustSkyfall 9mo ago
People are not happy with this because 4o, at least from what I've heard, seems to be much more willing to go down the relationship/friend path than 5.2 and Claude and the like.
- bettystaplesmd 9mo ago
  [dead]
m_fayer 9mo ago
I think 4o was more than just unusually sycophantic. It “understood people” better and had a kind of writerly creativity. I used it to help brainstorm and troubleshoot fiction: character motivations, arcs, personality, etc. And it was truly useful for that purpose. 4.5 was also good at this, but none of the other models I’ve tried. Of course this particular strength is dangerous in the hands of lonely unstable people and I think it’s dangerous to just have something like that openly out there. This really shows that we need a safe way to deploy models with dangerous specializations.
- co_king_3 9mo ago
  > Of course this particular strength is dangerous in the hands of lonely unstable people and I think it’s dangerous to just have something like that openly out there. Thank you for saying this
- bityard 9mo ago
  I'm of the persuasion that if people need help, it's better to get them that help instead of nerfing the tools for everyone.
  - m_fayer 9mo ago
    I agree with you, but safeguarding the vulnerable while preserving access for the fit is something we as societies know how to do, if we try.

oidar 9mo ago

From the subreddit I linked in another comment, there did seem to be some "magic" that 4o had for these kinds of "relationships". I'm not sure how much of it is placebo, but there does seem to be a strong preference in that user group.

satvikpendem 9mo ago
It probably is placebo. Character AI for example used DeepSeek and I'm sure many grew attachments to that model. Ultimately though I don't even get it, models lose context very quickly so it's hard to have long running conversations with them, as well as talking very sycophanticly to you. I guess this is fixed due to implementing a good harness and memories, which is what these companies did I assume.
- Griffinsauce 9mo ago
  > as well as talking very sycophanticly to you. That's apparently a feature to a significant amount of people..
rtkwe 9mo ago
4o was very sycophantic so was very willing to play along with and validate the users roleplay. OpenAI even noticed enough to talk about it in a blog: https://openai.com/index/sycophancy-in-gpt-4o/ https://openai.com/index/sycophancy-in-gpt-4o/
- co_king_3 9mo ago
  > OpenAI even noticed enough to talk about it in a blog That's one way of interpreting things...
  - rtkwe 9mo ago
    What do you even mean by this.
    - co_king_3 9mo ago
      I suspect that OpenAI knew that their product was addictive, potentially dialed up the addictiveness as a business strategy, and is playing dumb about the whole thing.
      - rtkwe 9mo ago
        I think they say as much in the blog post, essentially "we were tuning for use but way over shot the mark and now people are dating out model".
        co_king_3 9mo ago
        I don't believe them.
        satvikpendem 9mo ago
        Then why would they have toned it down in future releases? If they really wanted to make it addictive they'd have turned it up, like social media companies do with their algorithms.
        rtkwe 9mo ago
        They've definitely acted like it so I'm not sure what else I can give you. Look at the GPT5 reactions to poeple trying to continue their 'relationships' after the forced upgrade: https://www.reddit.com/r/MyBoyfriendIsAI/comments/1qx3jux/what_the_hell_is_wrong_with_gpt_wow_this_is_awful/ https://www.reddit.com/r/MyBoyfriendIsAI/comments/1qx3jux/wh... That's an actively harsh response, pushing these people away from the idea GPT is in a relationship with them. So even if the initial tune was meant to increase the attach and retention rate their actions show they don't like the way it turned out to influence people who were using it as a friend/lover bot.

odyssey7 9mo ago

It’s great marketing though

einpoklum 9mo ago

I can't believe they would stoop so low as this kind of character assassination.

roywiggins 9mo ago

One version of 4o was so sycophantic that it had to be rolled back, so there is some evidence that 4o specifically has a problem with this. https://openai.com/index/sycophancy-in-gpt-4o/ https://openai.com/index/sycophancy-in-gpt-4o/

rtkwe 9mo ago

After 4o they put in more safeguard reactions to the user attempting the kind of (lets be generous here) romantic roleplay that got a lot of people really invested in their AI "friends/partners". ex: https://www.reddit.com/r/MyBoyfriendIsAI/comments/1qx3jux/what_the_hell_is_wrong_with_gpt_wow_this_is_awful/ https://www.reddit.com/r/MyBoyfriendIsAI/comments/1qx3jux/wh...

JustSkyfall 9mo ago

People are not happy with this because 4o, at least from what I've heard, seems to be much more willing to go down the relationship/friend path than 5.2 and Claude and the like.

bettystaplesmd 9mo ago
[dead]

m_fayer 9mo ago

I think 4o was more than just unusually sycophantic. It “understood people” better and had a kind of writerly creativity. I used it to help brainstorm and troubleshoot fiction: character motivations, arcs, personality, etc. And it was truly useful for that purpose. 4.5 was also good at this, but none of the other models I’ve tried. Of course this particular strength is dangerous in the hands of lonely unstable people and I think it’s dangerous to just have something like that openly out there. This really shows that we need a safe way to deploy models with dangerous specializations.

co_king_3 9mo ago
> Of course this particular strength is dangerous in the hands of lonely unstable people and I think it’s dangerous to just have something like that openly out there. Thank you for saying this
bityard 9mo ago
I'm of the persuasion that if people need help, it's better to get them that help instead of nerfing the tools for everyone.
- m_fayer 9mo ago
  I agree with you, but safeguarding the vulnerable while preserving access for the fit is something we as societies know how to do, if we try.