4 ms·
"Lying" is an interesting way of characterizing ChatGPT, and I don't think it's quite accurate. Language models are trained to mimic human language, without an
by powersnail 4y ago
"Lying" is an interesting way of characterizing ChatGPT, and I don't think it's quite accurate.
Language models are trained to mimic human language, without any regard to the veracity of statements and arguments. Even when it gives the correct answer, it's not really because it is trying to be truthful. If you ask ChatGPT who's the best violinist in the world, it might tell you Perlman, which is a reasonable answer, but ChatGPT has never actually heard any violin playing. It answers so, because it read so.
In a way, ChatGPT is like a second-language learner taking a spoken English test: speaking in valid English, mainly taking inspirations from whatever books and articles that were read before, but bullshitting is also fine. The point is to generate valid English that's relevant to the question.
- ClumsyPilot 4y ago> If you ask ChatGPT who's the best violinist in the world, it might tell you Perlman, which is a reasonable answer, but ChatGPT has never actually heard any violin playing. It answers so, because it read so. Thus oaragraph qually applies to me and half the people on earth
- powersnail 4y agoMost people who don't know the answer will just tell you that they don't know, though.
- JoshTriplett 4y agoAnd ideally, people who don't know the answer firsthand but know a secondhand answer would tell you their source. "I haven't heard myself, but X and Y and many others say that Z is one of the best players in the world." In general, effort by an LLM to cite sources would be nice.
- the_gipsy 4y agoBut anyone who has read that fact on wikipedia will tell it .
- jaggederest 4y agoVanishingly uncommon to actually hear "I don't know" as the answer to a casual inquiry, unless it's on an obviously specialist topic. The Dunning-Kruger effect happens with a lot of things that are day-to-day.
- dragonwriter 4y ago> The Dunning-Kruger effect happens with a lot of things that are day-to-day. Ironically, the Dunning-Kruger effect (in which perceived relative skills tends to track with actual relative skill but is, on average, shifted somewhat towards about the 70th percentile from its actual value, for people on either side of that) is a frequent subject of what people misdescribe as the “Dunning-Kruger effect”, where people act extremely knowledgeable about a subject with very little knowledge of it.
- adrr 4y agoLying is around capabilities. It will tell me it knows nothing about my company and is not connected to the internet but when i ask it to write a sales pitch on my company's product, it will go into detail about proprietary features of our product and why people like it.
- deleted 4y ago[deleted]
- v3ss0n 4y agoIf that's true, that's actually mischievous. Lying 100% at least by their creator
- bagels 4y agoHumans have trained it to tell us things that are not true. Whether we call that lying or not is kind of immaterial. It will produce outputs that are not true, even when we know it's not true, and it has access to truthful information.
- a9h74j 4y ago> If you ask ChatGPT who's the best violinist in the world, it might tell you Perlman, which is a reasonable answer, but ChatGPT has never actually heard any violin playing. It answers so, because it read so. Are philosophers revisiting "Chinese Room" discussions yet?