3 ms·

I don't expect ChatGPT to say true things. But I have asked complicated technical questions that it provided detail, correct and useful answers to. And I have a

I don't expect ChatGPT to say true things. But I have asked complicated technical questions that it provided detail, correct and useful answers to. And I have asked other complicated questions and it's provided plausible sounding whole-cloth fabrications that it further gave references to. Knowing human beings, this is the level of plausibility where people start to believe the thing. People aren't good at seeing plausible arguments as out-and-out fabrications. So, yes, this is past some threshold despite being far from AGI. I mean, Google is probably pasted that threshold too but Google only gives existing websites (which can be filled with lies too).

shiredude95 4y ago
A workaround i've found is to always reply with "no you're wrong" for each seed reply. This forces it to either add more detail or in some cases give a completely different answer. If the replies are in the same ballpark, there is a good chance its not hallucinating. If it gives a completely different answer you are better off rewording the prompt or scrutinizing the answers more than you typically would.
- joe_the_user 4y ago
  Somehow everyone takes comments like my one above as being "my problem" with ChatGPT and offer "tips". Sure, there might be ways to correct the problem when it's gone off the rails and you happen to know that. That might make it more useful sure. But that's not the point. The point is that average people are going to ask things they don't know the answer to and put some credibility in it's answer because it's fairly good at seeming right and at some percentage being. Me improving my approach cannot change that. Tips on improving performance won't stop that. etc.
rvnx 4y ago
Based on that logic, if you want to sue ChatGPT for incorrect information, then you should sue Google for giving you incorrect information too (if it has presented you lies or dangerous materials).
- joe_the_user 4y ago
  Google does have to deal with sites devoted to systematic libel and extortion. I don't think there have been cases but there have been articles on the subject and after enough pressure is downranking extortion sites.
TimTheTinker 4y ago
I wonder if fabrications by LLMs like ChatGPT will end up becoming a net good for society. What I mean is, maybe we'll collectively (re)realize how absolutely vital truth and critical thinking are. I suppose whether we do depends on whether people in positions of influence begin to emphasize their importance in their writing and speaking.
- joe_the_user 4y ago
  ...maybe we'll collectively (re)realize how absolutely vital truth and critical thinking are... If two hundred years of scurrilous journalism didn't teach us this, I don't see why one lying machine would do so.
- fundad 4y ago
  Good point, convincing people to change their mind is not easy. Some cable news viewers want entertainment about labs and lasers rather than facts and a chat bot is incredibly entertaining. A chat bot can tell them the earth is billions of years old but they’ll just exit the chat, start searching and find it on some conspiracy website.

shiredude95 4y ago

A workaround i've found is to always reply with "no you're wrong" for each seed reply. This forces it to either add more detail or in some cases give a completely different answer. If the replies are in the same ballpark, there is a good chance its not hallucinating. If it gives a completely different answer you are better off rewording the prompt or scrutinizing the answers more than you typically would.

joe_the_user 4y ago
Somehow everyone takes comments like my one above as being "my problem" with ChatGPT and offer "tips". Sure, there might be ways to correct the problem when it's gone off the rails and you happen to know that. That might make it more useful sure. But that's not the point. The point is that average people are going to ask things they don't know the answer to and put some credibility in it's answer because it's fairly good at seeming right and at some percentage being. Me improving my approach cannot change that. Tips on improving performance won't stop that. etc.

rvnx 4y ago

Based on that logic, if you want to sue ChatGPT for incorrect information, then you should sue Google for giving you incorrect information too (if it has presented you lies or dangerous materials).

joe_the_user 4y ago
Google does have to deal with sites devoted to systematic libel and extortion. I don't think there have been cases but there have been articles on the subject and after enough pressure is downranking extortion sites.

TimTheTinker 4y ago

I wonder if fabrications by LLMs like ChatGPT will end up becoming a net good for society. What I mean is, maybe we'll collectively (re)realize how absolutely vital truth and critical thinking are. I suppose whether we do depends on whether people in positions of influence begin to emphasize their importance in their writing and speaking.

joe_the_user 4y ago
...maybe we'll collectively (re)realize how absolutely vital truth and critical thinking are... If two hundred years of scurrilous journalism didn't teach us this, I don't see why one lying machine would do so.
fundad 4y ago
Good point, convincing people to change their mind is not easy. Some cable news viewers want entertainment about labs and lasers rather than facts and a chat bot is incredibly entertaining. A chat bot can tell them the earth is billions of years old but they’ll just exit the chat, start searching and find it on some conspiracy website.