5 ms·

It hallucinated bonus answers. While contextually a serious issue, it is a known potential outcome of the system. Hence the human operator. Without that, the

It hallucinated bonus answers. While contextually a serious issue, it is a known potential outcome of the system. Hence the human operator. Without that, there is no bullshit detector. So the bullshit detector, instead of simply letting it remain bullshit, sent it to the subject of the hallucination. As the subject was so bothered by the hallucination, even the publication “cited” got involved. But there’s no story here. Someone with a significant name had their name randomly selected for a hallucination.

lisasays 4y ago
That's precisely the problem - far too many people have lousy bullshit detectors. And on top of that - they either genuinely believe that "AI is finally here", and systems like ChatGPT are true oracles. If it walks like a duck and talks like a duck, right?
- catchnear4321 4y ago
  > That's precisely the problem - far too many people have lousy bullshit detectors. Right. People are the problem, not technology. Which is why crippling the technology is so foolish.
  - lisasays 4y ago
    The issue isn't whether the technology should be crippled or not. Rather - as to whether the legal system holds those accountable (be it the creators of the technology, or those who "misuse" it) liable for the consequences of their actions.
    - catchnear4321 4y ago
      The creators liable for a hallucination? Consequences of what action? And yes, it has already been crippled in an effort to correct bias and to protect people from themselves.
      - lisasays 4y ago
        The creators liable for a hallucination? For hallucinations marketed and sold as a reliable source of information - yes. Consequences of what action? For what they do to others on the basis of the above.
        catchnear4321 4y ago
        Who is selling anything as a reliable source of information? Since that’s the basis of whatever this is.
        lisasays 4y ago
        Who is selling anything as a reliable source of information? OpenAI for example, whose marketing materials present it as exactly that. For example: You essentially have the knowledge of the most knowledgeable person in Wealth Management—instantly”, McMillan adds. “Think of it as having our Chief Investment Strategist, Chief Global Economist, Global Equities Strategist, and every other analyst around the globe on call for every advisor, every day. We believe that is a transformative capability for our company.
        catchnear4321 4y ago
        And did it have any note about not being a financial advisor? What else was said? I’m assuming there was more to it than that. We can move the goalposts to T&Cs being a problem, but that’s even further from AI being the problem. Wasn’t this supposed to be about the dangers of AI? This sounds, again, still, like the dangers of humans. With a new tool.
        lisasays 4y ago
        It's always been about the dangers of humans - specifically those who create and market products of this nature. With us as their unwilling test subjects.
  - latexr 4y ago
    > People are the problem, not technology. That’s the same argument as “guns don’t kill people, people kill people”. It pretends nothing is wrong, or that if it were that would be nothing we could do. None of those is true or a reason to not have a conversation.
    - TimTheTinker 4y ago
      Which is not to say the argument is necessarily a bad one. The key is - one has assume there will always be bad actors, and weigh potential outcomes of various policies with that assumption in mind. That assumption is how computer security has come such a long way in the last 20 years. In the case of guns, assuming bad actors means one cannot assume criminals will follow gun laws, but that manufacturers, distributors, and resellers will (for the most part).
      - latexr 4y ago
        > The key is - one has assume there will always be bad actors, and weigh potential outcomes of various policies with that assumption in mind. Agreed. And we have to discuss those policies, which is what we’re doing now. > Which is not to say the argument is necessarily a bad one. Which is why I disagree here. The argument to “ignore the thing itself because people are the problem” ignores the thing ultimately affects the people.
    - catchnear4321 4y ago
      > People are the problem > It pretends nothing is wrong, Not that one > or that if it were that would be nothing we could do. Also not that one. How about “this isn’t addressing the issue,” which is stated as… people?
      - latexr 4y ago
        The problem isn’t people in the abstract. At best the issue could be characterised as “people (mis)using the thing”. Trying to dismiss the thing as irrelevant wavers between the naïve and the disingenuous.
  - lepus 4y ago
    That's like saying people who see a door handle and instinctively pull are foolish because they missed the "push" sign, so just blame the people. It's not at all helpful no matter the veracity. Good technologies/rules are designed around people and our flaws even if eventually we're working on reducing said flaws.
    - catchnear4321 4y ago
      That analogy implies that ChatGPT is designed in a misleading way. ChatGPT has a long list of warnings, caveats, instructions, etc. Before you get to submit anything. Like T&Cs. If you don’t read them, yes, that’s on you. They may be unreasonable. But so were you when you decided they weren’t worth reading. This is in addition to all of the sensationalist headlines all over the place that talk about how unreliable the answers can be. Or rather those are in addition. They came second. After a lot of people didn’t read, or disregarded what they read. Edit: and could people stop anthropomorphizing the language model? It can’t accuse anyone of anything. That’s sensationalist garbage.
      - nkrisc 4y ago
        > ChatGPT has a long list of warnings, caveats, instructions, etc. Before you get to submit anything. Like T&Cs. If you don’t read them, yes, that’s on you. That’s little comfort for anyone whom ChatGPT falsely accuses of sexual harassment. The person who skips the warnings isn’t the person who’s harmed.
        catchnear4321 4y ago
        ChatGPT isn’t capable of accusations. It predicts text. Sometimes inaccurately. That’s what those silly words are trying to indicate. It is why they are worth reading. There’s even a prompt to make sure the user reads it. (Humans lie.) What the human then does with the output may resemble an accusation, or may even be one. I wonder if law professors take the time to read those silly words… I bet they do. All the more curious.
        4y ago
- justinclift 4y ago
  Some places have had pretty bad mob violence occur due to rumours from social media. A somewhat recent stand out example: https://en.wikipedia.org/wiki/Indian_WhatsApp_lynchings https://en.wikipedia.org/wiki/Indian_WhatsApp_lynchings These problems with ChatGPT sound like it's going to turbo charge events like this.
singleshot_ 4y ago
> Someone with a significant name had their name randomly selected for a hallucination. It seems that the story consists of, essentially, “Is this thing (which happened for the first time but that will presumably happen all of the time now) a tort?” In the context of a multibillion dollar company like Microsoft this is actually quite a story.
- catchnear4321 4y ago
  That’s the only reason it is a story. It’s a law professor. Teeth. Sure, quite the story, in a sense. Same as ever, in another.
  - rnk 4y ago
    I disagree. If my name suddenly appeared on the internet with a claim of a newspaper article about some crime I committed (where I never committed a crime and there was never an article either), I'd be upset and want it stopped. Anyone would. I can't understand your multiple claims that this is no big deal, nothing to worry. Can you please explain why you are trying to wish this problem away?

lisasays 4y ago

That's precisely the problem - far too many people have lousy bullshit detectors. And on top of that - they either genuinely believe that "AI is finally here", and systems like ChatGPT are true oracles. If it walks like a duck and talks like a duck, right?

catchnear4321 4y ago
> That's precisely the problem - far too many people have lousy bullshit detectors. Right. People are the problem, not technology. Which is why crippling the technology is so foolish.
- lisasays 4y ago
  The issue isn't whether the technology should be crippled or not. Rather - as to whether the legal system holds those accountable (be it the creators of the technology, or those who "misuse" it) liable for the consequences of their actions.
  - catchnear4321 4y ago
    The creators liable for a hallucination? Consequences of what action? And yes, it has already been crippled in an effort to correct bias and to protect people from themselves.
    - lisasays 4y ago
      The creators liable for a hallucination? For hallucinations marketed and sold as a reliable source of information - yes. Consequences of what action? For what they do to others on the basis of the above.
      - catchnear4321 4y ago
        Who is selling anything as a reliable source of information? Since that’s the basis of whatever this is.
        lisasays 4y ago
        Who is selling anything as a reliable source of information? OpenAI for example, whose marketing materials present it as exactly that. For example: You essentially have the knowledge of the most knowledgeable person in Wealth Management—instantly”, McMillan adds. “Think of it as having our Chief Investment Strategist, Chief Global Economist, Global Equities Strategist, and every other analyst around the globe on call for every advisor, every day. We believe that is a transformative capability for our company.
        catchnear4321 4y ago
        And did it have any note about not being a financial advisor? What else was said? I’m assuming there was more to it than that. We can move the goalposts to T&Cs being a problem, but that’s even further from AI being the problem. Wasn’t this supposed to be about the dangers of AI? This sounds, again, still, like the dangers of humans. With a new tool.
        lisasays 4y ago
        It's always been about the dangers of humans - specifically those who create and market products of this nature. With us as their unwilling test subjects.
- latexr 4y ago
  > People are the problem, not technology. That’s the same argument as “guns don’t kill people, people kill people”. It pretends nothing is wrong, or that if it were that would be nothing we could do. None of those is true or a reason to not have a conversation.
  - TimTheTinker 4y ago
    Which is not to say the argument is necessarily a bad one. The key is - one has assume there will always be bad actors, and weigh potential outcomes of various policies with that assumption in mind. That assumption is how computer security has come such a long way in the last 20 years. In the case of guns, assuming bad actors means one cannot assume criminals will follow gun laws, but that manufacturers, distributors, and resellers will (for the most part).
    - latexr 4y ago
      > The key is - one has assume there will always be bad actors, and weigh potential outcomes of various policies with that assumption in mind. Agreed. And we have to discuss those policies, which is what we’re doing now. > Which is not to say the argument is necessarily a bad one. Which is why I disagree here. The argument to “ignore the thing itself because people are the problem” ignores the thing ultimately affects the people.
  - catchnear4321 4y ago
    > People are the problem > It pretends nothing is wrong, Not that one > or that if it were that would be nothing we could do. Also not that one. How about “this isn’t addressing the issue,” which is stated as… people?
    - latexr 4y ago
      The problem isn’t people in the abstract. At best the issue could be characterised as “people (mis)using the thing”. Trying to dismiss the thing as irrelevant wavers between the naïve and the disingenuous.
- lepus 4y ago
  That's like saying people who see a door handle and instinctively pull are foolish because they missed the "push" sign, so just blame the people. It's not at all helpful no matter the veracity. Good technologies/rules are designed around people and our flaws even if eventually we're working on reducing said flaws.
  - catchnear4321 4y ago
    That analogy implies that ChatGPT is designed in a misleading way. ChatGPT has a long list of warnings, caveats, instructions, etc. Before you get to submit anything. Like T&Cs. If you don’t read them, yes, that’s on you. They may be unreasonable. But so were you when you decided they weren’t worth reading. This is in addition to all of the sensationalist headlines all over the place that talk about how unreliable the answers can be. Or rather those are in addition. They came second. After a lot of people didn’t read, or disregarded what they read. Edit: and could people stop anthropomorphizing the language model? It can’t accuse anyone of anything. That’s sensationalist garbage.
    - nkrisc 4y ago
      > ChatGPT has a long list of warnings, caveats, instructions, etc. Before you get to submit anything. Like T&Cs. If you don’t read them, yes, that’s on you. That’s little comfort for anyone whom ChatGPT falsely accuses of sexual harassment. The person who skips the warnings isn’t the person who’s harmed.
      - catchnear4321 4y ago
        ChatGPT isn’t capable of accusations. It predicts text. Sometimes inaccurately. That’s what those silly words are trying to indicate. It is why they are worth reading. There’s even a prompt to make sure the user reads it. (Humans lie.) What the human then does with the output may resemble an accusation, or may even be one. I wonder if law professors take the time to read those silly words… I bet they do. All the more curious.
        4y ago
justinclift 4y ago
Some places have had pretty bad mob violence occur due to rumours from social media. A somewhat recent stand out example: https://en.wikipedia.org/wiki/Indian_WhatsApp_lynchings https://en.wikipedia.org/wiki/Indian_WhatsApp_lynchings These problems with ChatGPT sound like it's going to turbo charge events like this.

singleshot_ 4y ago

> Someone with a significant name had their name randomly selected for a hallucination. It seems that the story consists of, essentially, “Is this thing (which happened for the first time but that will presumably happen all of the time now) a tort?” In the context of a multibillion dollar company like Microsoft this is actually quite a story.

catchnear4321 4y ago
That’s the only reason it is a story. It’s a law professor. Teeth. Sure, quite the story, in a sense. Same as ever, in another.
- rnk 4y ago
  I disagree. If my name suddenly appeared on the internet with a claim of a newspaper article about some crime I committed (where I never committed a crime and there was never an article either), I'd be upset and want it stopped. Anyone would. I can't understand your multiple claims that this is no big deal, nothing to worry. Can you please explain why you are trying to wish this problem away?