5 ms·

While it is probably pretty normal for California, the insincere flattery and patronizing eagerness are definitely grating But then you have to stack that up ag

While it is probably pretty normal for California, the insincere flattery and patronizing eagerness are definitely grating But then you have to stack that up against the fact that we are examining a technology and nitpicking over its tone of voice.

MattPalmer1086 2y ago
I found it disturbing that it had any kind of personality. I don't want a machine to pretend to be a person. I guess it makes it more evident with a voice than text. But yeah, I'm sure all those things would be tunable, and everyone could pick their own style.
- jimkleiber 2y ago
  For me, you nailed it. Maybe how I feel on this will change over time, yet at the moment (and since the movie Her), I feel a deep unsettling, creeped out, disgusted feeling at hearing a computer pretend to be a human. I also have never used Siri or Alexa. At least with those, they sound robotic and not like a human. I watched a video of an interview with an AI Reed Hastings and had a similar creeped out feeling. It's almost as if I want a human to be a human and a computer to be a computer. I wonder if I would feel the same way if a dog started speaking to me in English and sounded like my deceased grandmother or a woman who I found very attractive. Or how I'd feel if this tech was used in videogames or something where I don't think it's real life. I don't really know how to put it into words, maybe just uncanny valley.
  - Intralexical 2y ago
    It's dishonest to the core. "Emotions" which it doesn't actually feel are just a way to manipulate you.
    - jimkleiber 2y ago
      Yea, gives that con artist vibe. "I'm sorry, I can't help you with that." But you're not sorry, you don't feel guilt. I think in the video it even asked "how are you feeling" and it replied, which creeped me out. The computer is not feeling. Maybe if it said, "my battery is a bit warm right now I should turn on my fan" or "I worry that my battery will die" then I'd trust it more. Give me computer emotions, not human emotions.
      - Intralexical 2y ago
        What creeps me out is that this is clearly being done deliberately. They know the computer is not feeling. But they very much want to present it as if it is.
        cruffle_duffle 2y ago
        It will be interesting to see the different ways competitors train their models to behave.
        jimkleiber 2y ago
        From a tech standpoint, I admire its ability to replicate tone and such on the fly. I just don't know how it'll do from a user experience standpoint. Many stories of fascinating tech achievements that morphed a lot to be digestible by us humans.
    - MattPalmer1086 2y ago
      Douglas Adams predicted it, we are now in the era of Genuine People Personalities™... https://hitchhikers.fandom.com/wiki/Genuine_People_Personalities https://hitchhikers.fandom.com/wiki/Genuine_People_Personali... "All the doors in this spacecraft have a cheerful and sunny disposition. It is their pleasure to open for you and their satisfaction to close again with the knowledge of a job well done"!
- Valakas_ 2y ago
  It sounded like a sociopath. All emotions are faked, they're both just doing what they think is more appropriate in that situation since they have no feelings on their own to guide them. And the lack of empathy becomes clear, it's all just cognitive. When the GPT voice was talking about the dog it was incredibly objectifying, got triggered from my ex. "What an adorable fluffy ball" "cute little thing". The reason we feel creeped out is because at an instinctual level we know people (and now things) with no empathy and inauthentic are dangerous. They don't really care or feel, just pretend to.
zamadatix 2y ago
I feel like it's largely an effect of tuning it to default as "a ultra helpful assistant which is happy to help with any request via detailed responses in candid and polite manner..." kind of thing as you basically lose free points any time it doesn't jump on helping with something, tries to use short output and generates a more incorrect answer as a result, or just plain has to be initialized with any of this info. It seems like both the voice and responses can be tuned pretty easily though so hopefully that kind of thing can just be loaded in your custom instructions.
TaylorAlexander 2y ago
I’m born and raised in California and I think I’m a pretty “California” person (for better and worse). It feels exhausting watching these demos and I’m not excited at all to try it. I really don’t feel the need for an AI assistant or chatbot to pretend to be human like this. It just feels like it’s taking longer to get the information I want. You know in the TV series “Westworld” they have this mode, called “analysis”, where they can tell the robots to “turn off your emotional affect”. I’d really like to see this one have that option. Hopefully it will comply if you tell it, but considering how strong some of the RLHF has been in the past I’m not confident in that.
- jameshart 2y ago
  I found it jarring that the presenters keep beginning dialogs by asking the chatbot how it is. It’s stateless. There is no ‘how’ for it to be. Why are you making it roleplay as a human being forced to make small talk?
  - Intralexical 2y ago
    They know that it's stateless, of course. Clearly they have decided it's in their own interests to publicly pretend otherwise.
    - vbezhenar 2y ago
      With Memory, ChatGPT is not exactly stateless anymore. Doesn't make any sense to ask robot how he is, of course. Though I never understood why people ask it each other, because obviously absolute majority of them don't genuinely care. "Hi" should be enough for verbal part of the handshake protocol.
  - gradys 2y ago
    I’m guessing there was an instrumental reason for this, for instance to check that the model was listening before launching into what they wanted to demo
    - 2y ago
65 2y ago
Maybe they need to make a North Easterner mode. Cut the bullshit and pleasantries. Give me the information and move on!

MattPalmer1086 2y ago

I found it disturbing that it had any kind of personality. I don't want a machine to pretend to be a person. I guess it makes it more evident with a voice than text. But yeah, I'm sure all those things would be tunable, and everyone could pick their own style.

jimkleiber 2y ago
For me, you nailed it. Maybe how I feel on this will change over time, yet at the moment (and since the movie Her), I feel a deep unsettling, creeped out, disgusted feeling at hearing a computer pretend to be a human. I also have never used Siri or Alexa. At least with those, they sound robotic and not like a human. I watched a video of an interview with an AI Reed Hastings and had a similar creeped out feeling. It's almost as if I want a human to be a human and a computer to be a computer. I wonder if I would feel the same way if a dog started speaking to me in English and sounded like my deceased grandmother or a woman who I found very attractive. Or how I'd feel if this tech was used in videogames or something where I don't think it's real life. I don't really know how to put it into words, maybe just uncanny valley.
- Intralexical 2y ago
  It's dishonest to the core. "Emotions" which it doesn't actually feel are just a way to manipulate you.
  - jimkleiber 2y ago
    Yea, gives that con artist vibe. "I'm sorry, I can't help you with that." But you're not sorry, you don't feel guilt. I think in the video it even asked "how are you feeling" and it replied, which creeped me out. The computer is not feeling. Maybe if it said, "my battery is a bit warm right now I should turn on my fan" or "I worry that my battery will die" then I'd trust it more. Give me computer emotions, not human emotions.
    - Intralexical 2y ago
      What creeps me out is that this is clearly being done deliberately. They know the computer is not feeling. But they very much want to present it as if it is.
      - cruffle_duffle 2y ago
        It will be interesting to see the different ways competitors train their models to behave.
      - jimkleiber 2y ago
        From a tech standpoint, I admire its ability to replicate tone and such on the fly. I just don't know how it'll do from a user experience standpoint. Many stories of fascinating tech achievements that morphed a lot to be digestible by us humans.
  - MattPalmer1086 2y ago
    Douglas Adams predicted it, we are now in the era of Genuine People Personalities™... https://hitchhikers.fandom.com/wiki/Genuine_People_Personalities https://hitchhikers.fandom.com/wiki/Genuine_People_Personali... "All the doors in this spacecraft have a cheerful and sunny disposition. It is their pleasure to open for you and their satisfaction to close again with the knowledge of a job well done"!
Valakas_ 2y ago
It sounded like a sociopath. All emotions are faked, they're both just doing what they think is more appropriate in that situation since they have no feelings on their own to guide them. And the lack of empathy becomes clear, it's all just cognitive. When the GPT voice was talking about the dog it was incredibly objectifying, got triggered from my ex. "What an adorable fluffy ball" "cute little thing". The reason we feel creeped out is because at an instinctual level we know people (and now things) with no empathy and inauthentic are dangerous. They don't really care or feel, just pretend to.

zamadatix 2y ago

I feel like it's largely an effect of tuning it to default as "a ultra helpful assistant which is happy to help with any request via detailed responses in candid and polite manner..." kind of thing as you basically lose free points any time it doesn't jump on helping with something, tries to use short output and generates a more incorrect answer as a result, or just plain has to be initialized with any of this info. It seems like both the voice and responses can be tuned pretty easily though so hopefully that kind of thing can just be loaded in your custom instructions.

TaylorAlexander 2y ago

I’m born and raised in California and I think I’m a pretty “California” person (for better and worse). It feels exhausting watching these demos and I’m not excited at all to try it. I really don’t feel the need for an AI assistant or chatbot to pretend to be human like this. It just feels like it’s taking longer to get the information I want. You know in the TV series “Westworld” they have this mode, called “analysis”, where they can tell the robots to “turn off your emotional affect”. I’d really like to see this one have that option. Hopefully it will comply if you tell it, but considering how strong some of the RLHF has been in the past I’m not confident in that.

jameshart 2y ago
I found it jarring that the presenters keep beginning dialogs by asking the chatbot how it is. It’s stateless. There is no ‘how’ for it to be. Why are you making it roleplay as a human being forced to make small talk?
- Intralexical 2y ago
  They know that it's stateless, of course. Clearly they have decided it's in their own interests to publicly pretend otherwise.
  - vbezhenar 2y ago
    With Memory, ChatGPT is not exactly stateless anymore. Doesn't make any sense to ask robot how he is, of course. Though I never understood why people ask it each other, because obviously absolute majority of them don't genuinely care. "Hi" should be enough for verbal part of the handshake protocol.
- gradys 2y ago
  I’m guessing there was an instrumental reason for this, for instance to check that the model was listening before launching into what they wanted to demo
  - 2y ago

65 2y ago

Maybe they need to make a North Easterner mode. Cut the bullshit and pleasantries. Give me the information and move on!