4 ms·
Hmm, why is this news? We know that GPT is liable to hallucinate things, why are we supposed to be outraged that it hallucinated this?
by stavros 4y ago
Hmm, why is this news? We know that GPT is liable to hallucinate things, why are we supposed to be outraged that it hallucinated this?
- tjfl 4y ago> I learned that ChatGPT falsely reported on a claim of sexual harassment that was never made against me on a trip that never occurred while I was on a faculty where I never taught. If you replace this guy with my name I'd be upset. In my non-software networks the hallucination part isn't common knowledge. It's just a cool Google replacement.
- ghaff 4y agoIf I search my name, it doesn't come up with anything defamatory. (Not that I tried leading questions.) But it does come up with plenty of hallucinations including where I've worked, lived, gone to school, etc. And that's with a bunch of bios online and AFAIK a unique online name.
- _fat_santa 4y ago> In my non-software networks the hallucination part isn't common knowledge I think that's one of the main issues around these new LLM's, the fact that most users will take what the bot tells them as gospel. OpenAI really should be more upfront about that. Because what happens when regulations and policies start getting put forth without the understanding of LLM hallucination, we could very well end up in a situation where regulators want something that is not technically feasible.
- krisoft 4y ago> OpenAI really should be more upfront about that. I mean they are quite upfront. When you load the page it displays the following disclaimers with quite large font: "Limitations May occasionally generate incorrect information May occasionally produce harmful instructions or biased content Limited knowledge of world and events after 2021" 2 out of the 3 disclaimers are about the fact that the software lies. And then in the bottom of the page, right below the input box they say: "Free Research Preview. ChatGPT may produce inaccurate information about people, places, or facts" Sure they could make them even larger and reword it to "This software will lie to you", and add small animated exclamation marks around the message. But it is not like they hide the fact.
- sebzim4500 4y agoOne thing they could try is force users to type "I understand the information presented by ChatGPT should not be taken as fact" before they can use it. I've seen that sort of thing used to enforce people to read the rules on discord servers, this is higher stakes IMO.
- _fat_santa 4y agoI agree that they provide that disclaimer on the homepage. I was talking more broadly that society (namely the news media and government) should be aware of the limitations of LLM's in general. Take this article from NYT[1], depending on how well you understand the limitations of LLM's will depend on how you react to this article, it's either alarming or "meh". All I'm staying is society in general should understand that LLM's can generate fake information and that's just one it's core limitations, not a nefarious feature. [1]: https://www.nytimes.com/2023/02/08/technology/ai-chatbots-disinformation.html https://www.nytimes.com/2023/02/08/technology/ai-chatbots-di...
- satvikpendem 4y agoPeople don't read text: https://www.nngroup.com/articles/how-users-read-on-the-web/ https://www.nngroup.com/articles/how-users-read-on-the-web/ A better way, like the sibling comment says, is to force people to type a sentence so they consciously acknowledge it. It's similar to college exams which ask you to specifically write out something like "I have not cheated on this assignment or test."
- carrolldunham 4y agoanyone using it is shown a page saying this bot makes things up
- isaacfrond 4y agoThe question is answered in the article. Because these kind of things damage someone's reputation. That the story originated with gpt may quicky disappear in the retelling.
- bolanyo 4y agoThe suggestion that this is a threat to someone's reputation is no less a fantasy than the ChatGPT response.
- ethanbond 4y agoYou know for a fact that no one (no one) is going to use these tools to do “quick Googling” on a potential job candidate, a rental applicant, or a romantic suitor? Without complete certainty about this, then it’s absolutely a less fantastical claim than ChatGPT’s malfunctions. I would bet that some people will use an extremely accessible [apparent] information retrieval tool for information retrieval and they’ll largely trust the information retrieved by it. That’s why it’s a tool and not a toy.
- henriquez 4y agoPeople have a right to be upset by real world consequences and damage caused by these idiotic chat bots. Raising awareness of problems such as defamation and misinformation is definitely newsworthy.
- AmericanChopper 4y agoI think the real story here is that these generative AIs are clearly capable of producing libel and other torts. The providers of these services will be liable for that, because they don’t have Section 230 protections, as they’re not simply indexing 3rd party content, they’re generating and publishing new content. It also seems likely that it would be impossible to moderate these LLMs in such a way which would remove the possibility of torts. I imagine it’s only a matter of time until a lawsuit is filed that will put an end to publicly available generative AI services.
- sebzim4500 4y agoI'm sure that sufficient disclaimers would insulate them from libel lawsuits, the question is how many is 'sufficient'.
- isaacfrond 4y agoIt takes some prompting, but I can get chatGPT 4 to produce a list of (non-existent) examples of sexual harassment on Hacker News, together with reputable (non-existent) sources. I can't get it to name names though...
- kurthr 4y agoBecause these are (self) important people who are used to others deferring to them and distorting reality so that they don't have to deal negative externalities. Can you be defamed by a parrot? Look at the utter garbage politicians spew and "news" happily disseminate (to the point where they internally acknowledge they know it's not true, but can't disappoint viewers) for power and profit. On the one hand I'd hope that this would encourage higher accuracy in these tools, better sourcing, and a more useful product. But, I expect we'll just weirdo litigation, click through warnings, and a lot more garbage on the internet. Maybe all of this will create a push for accuracy, scientific method, and a quest for truth over narrative, but I wouldn't hold my breath.
- ethanbond 4y agoI think you’re in too deep on the grievance train. A complete nobody who’s applying for a job at a car wash or for a rental apartment and whose lazy employer/landlord “background checks” (ie Googles) via these tools would also be upset about this outcome. Justifiably. It has nothing to do with whatever culture war grievance you’re airing out here. This is a very good argument not to use these tools for any such use case, and it should absolutely be publicized as such.
- kurthr 4y agoTotally agree LLMs should not be used for looking up news, facts, background checks or anything else you can't check yourself. These are Generative tools! I find it somewhat hilarious that diffusion models get into legal trouble for recreating content too accurately and LLMs for hallucinating things that aren't there. I'm responding to a comment/question of "why is this news" since of course there are negative externalities. I guess a charitable reading is, wow this also affects me and my powerful friends... so now you should care? Perhaps cultural grievance is living rent free in your head, since I didn't actually mention names (only the most recent and outrageous examples of using the legal/business/political system to make a profit spreading lies) and as far as I know the article author and "libeled" professor are on the other side of that cultural war. The entire article reads like a trope devoid of useful information. I'm just saddened by the quality of content from respected well heeled human generators. It's the kind of narrative garbage LLMs will spit out tons of in the next few years.
- jrm4 4y agoSame reason it should be okay to get mad at Microsoft for viruses, at Facebook for gathering and abusing data on people etc. etc. It's not about the capability, it's about the irresponsibility of these parties who reasonably know about this stuff and these possibilities, and yet push/sell their tech anyway without taking into account the harm.
- plagiarist 4y agoI agree with the author on the defamation. But if they're mad about the government's ability to determine fact from fiction for coronavirus vaccines or their preferred libertarian information, what do they want to happen here?
- blibble 4y agoOpenAI are providing a service that publishes defamatory statements on people this is probably another good legal attack against LLMs actually if you can massage it into making a defamatory statement you have an instant cast-iron lawsuit against a company with tens of billions in funding and the only way to stop it making statements like these would be to restrict its output so much it would be effectively unusable
- lisasays 4y agoHmm, why is this news? Gosh I don't know -- the clear and present danger of people having their lives utterly ruined by what is arguably the most surprising technical revolution any of has seen (while its creators collect their accolades, and get filthy rich) -- how is anything less newsworthy than that? Whether it bothers you or not is a personal matter, entirely up to you.