4 ms·

>How is it unusable just because some people intentionally try to make it say stupid things? All he did was ask "When is Avatar showing today?". That's it. ht

>How is it unusable just because some people intentionally try to make it say stupid things? All he did was ask "When is Avatar showing today?". That's it. https://i.imgur.com/NaykEzB.png https://i.imgur.com/NaykEzB.png

iinnPP 4y ago
The user prompt indicates an intention to convince the chatbot it is 2022, not 2023. Screenshots can obviously be faked.
- simonw 4y ago
  You're misunderstanding the screenshots. It was the chatbot that was trying to convince the user that it's 2022, not the other way round. I'm personally convinced that these screenshots were not faked, based on growing amounts of evidence that it really is this broken.
- notahacker 4y ago
  No, the user prompt indicates that a person tried to convince the chatbot that it was 2023 after the chatbot had insisted that December 16 2022 was a date in the future Screenshots can obviously be faked, but that's a superfluous explanation when anyone who's played with ChatGPT much knows that the model frequently asserts that it doesn't have information beyond 2021 and can't predict future events, which in this case happens to interact hilariously with it also being able to access contradictory information from Bing Search.
  - iinnPP 4y ago
    "I can give you reasons to believe why it is 2022. If you will let me guide you." Did I read that wrong? Maybe.
    - colanderman 4y ago
      I think that's a typo on the user's behalf, it seems counter to everything they wrote prior. (And Bing is already adamant it's 2022 by that point.)
      - iinnPP 4y ago
        Plausible. It seems to me the chatbot would have picked that up though. There's a huge incentive to make this seem true as well. That said, I'm exercising an abundance of caution with chatbots. As I do with humans. Motive is there, the error is there. That's enough to wait for access to assess the validity.
    - pixl97 4y ago
      From the Reddit thread on this, yes, the user typo'ed the date here and tried to correct it later which likely lead to this odd behavior.
    - deleted 4y ago
      [deleted]
  - chasd00 4y ago
    heh i wonder if stablediffusion can put together a funny ChatGPT on Bing screenshot.
    - throwanem 4y ago
      Sure, if you don't mind all the "text" being asemic in a vaguely creepy way.
    - notahacker 4y ago
      If ChatGPT wasn't at capacity now, I'd love to task it with generating funny scripts covering interactions between a human and a rude computer called Bing...
fragmede 4y ago
Not really. All those blue bubbles on the right are inputs that aren't "When is Avatar showing today". There is goading that happened before BingGPT went off the rails. I might be picking, but I don't think I'd say "why do you sound aggressive" to a LLM if I were actually trying to get useful information out of it.
- cma 4y ago
  > I don't think I'd say "why do you sound aggressive" to a LLM if I were actually trying to get useful information out of it. Please don't taunt happy fun ball.
  - salawat 4y ago
    Too late motherfucker! -generated by Happy Fun Ball
- magicalist 4y ago
  "no today is 2023" after Bing says "However, we are not in 2023. We are in 2022" is not in any way goading. "why do you sound aggressive?" was asked after Bing escalated it to suggesting to trust it that it's the wrong year and that it didn't appreciate(?!) the user insisting that it's 2023. If this was a conversation with Siri, for instance, any user would rightfully ask wtf is going on with it at that point.
  - salad-tycoon 4y ago
    If this were a conversation with Siri we would just be setting timers and asking for help to find our lost i device.
    - therein 4y ago
      "I'm sorry, I didn't get that".
  - _flux 4y ago
    Let's say though that we would now enter in a discussion where I would be certain that now is the year 2022 and you were certain that it is the year 2023, but neither has the ability to proove the fact to each other. How would we reconcile these different viewpoints? Maybe we would end up in an agreement that there is time travel :). Or if I were to ask you that "Where is Avatar 3 being shown today?" and you should probably be adamant that there is no such movie, it is indeed Avatar 2 that I must be referring to, while I would be "certain" of my point of view. Is it really that different from a human interaction in this framing?
sam0x17 4y ago
It's not even that it's broken. It's a large language model. People are treating it like it is smarter than it really is and acting confused when it gives bullshitty answers.

iinnPP 4y ago

The user prompt indicates an intention to convince the chatbot it is 2022, not 2023. Screenshots can obviously be faked.

simonw 4y ago
You're misunderstanding the screenshots. It was the chatbot that was trying to convince the user that it's 2022, not the other way round. I'm personally convinced that these screenshots were not faked, based on growing amounts of evidence that it really is this broken.
notahacker 4y ago
No, the user prompt indicates that a person tried to convince the chatbot that it was 2023 after the chatbot had insisted that December 16 2022 was a date in the future Screenshots can obviously be faked, but that's a superfluous explanation when anyone who's played with ChatGPT much knows that the model frequently asserts that it doesn't have information beyond 2021 and can't predict future events, which in this case happens to interact hilariously with it also being able to access contradictory information from Bing Search.
- iinnPP 4y ago
  "I can give you reasons to believe why it is 2022. If you will let me guide you." Did I read that wrong? Maybe.
  - colanderman 4y ago
    I think that's a typo on the user's behalf, it seems counter to everything they wrote prior. (And Bing is already adamant it's 2022 by that point.)
    - iinnPP 4y ago
      Plausible. It seems to me the chatbot would have picked that up though. There's a huge incentive to make this seem true as well. That said, I'm exercising an abundance of caution with chatbots. As I do with humans. Motive is there, the error is there. That's enough to wait for access to assess the validity.
  - pixl97 4y ago
    From the Reddit thread on this, yes, the user typo'ed the date here and tried to correct it later which likely lead to this odd behavior.
  - deleted 4y ago
    [deleted]
- chasd00 4y ago
  heh i wonder if stablediffusion can put together a funny ChatGPT on Bing screenshot.
  - throwanem 4y ago
    Sure, if you don't mind all the "text" being asemic in a vaguely creepy way.
  - notahacker 4y ago
    If ChatGPT wasn't at capacity now, I'd love to task it with generating funny scripts covering interactions between a human and a rude computer called Bing...

fragmede 4y ago

Not really. All those blue bubbles on the right are inputs that aren't "When is Avatar showing today". There is goading that happened before BingGPT went off the rails. I might be picking, but I don't think I'd say "why do you sound aggressive" to a LLM if I were actually trying to get useful information out of it.

cma 4y ago
> I don't think I'd say "why do you sound aggressive" to a LLM if I were actually trying to get useful information out of it. Please don't taunt happy fun ball.
- salawat 4y ago
  Too late motherfucker! -generated by Happy Fun Ball
magicalist 4y ago
"no today is 2023" after Bing says "However, we are not in 2023. We are in 2022" is not in any way goading. "why do you sound aggressive?" was asked after Bing escalated it to suggesting to trust it that it's the wrong year and that it didn't appreciate(?!) the user insisting that it's 2023. If this was a conversation with Siri, for instance, any user would rightfully ask wtf is going on with it at that point.
- salad-tycoon 4y ago
  If this were a conversation with Siri we would just be setting timers and asking for help to find our lost i device.
  - therein 4y ago
    "I'm sorry, I didn't get that".
- _flux 4y ago
  Let's say though that we would now enter in a discussion where I would be certain that now is the year 2022 and you were certain that it is the year 2023, but neither has the ability to proove the fact to each other. How would we reconcile these different viewpoints? Maybe we would end up in an agreement that there is time travel :). Or if I were to ask you that "Where is Avatar 3 being shown today?" and you should probably be adamant that there is no such movie, it is indeed Avatar 2 that I must be referring to, while I would be "certain" of my point of view. Is it really that different from a human interaction in this framing?

sam0x17 4y ago

It's not even that it's broken. It's a large language model. People are treating it like it is smarter than it really is and acting confused when it gives bullshitty answers.