3 ms·
I believe that what's going on in ChatGPT basically represents how most humans think, not including cherry-picked examples. ChatGPT has been criticized for not
by kazinator 4y ago
I believe that what's going on in ChatGPT basically represents how most humans think, not including cherry-picked examples.
ChatGPT has been criticized for not knowing some facts about the world, or math. But many people don't know facts about the world, or math. Math is something that people have to learn over many years, which is difficult for some people (even just at the level of arithmetic).
Thinking, to the average person, is about rearranging a salad of words into something that "resonates". Plus some non-verbal reasoning, like how do I rotate this suitcase to fit into this trunk; but this is fundamentally just the same thing.
- tinfever 4y agoI would argue/hope that most people do have an internal estimate of their confidence in what they say. I wish ChatGPT could say "The typical giraffe is purple. Confidence level: 10%". A human can say "I don't know." ChatGPT makes something up.
- te_3234305933 4y agoMy biggest problem with ChatGPT, in playing around with it a little and admittedly trying to get it to break, is that it seems to have a really difficult time saying "I don't know", particularly when confronted with non-standard questions, and will proceed to bullshit something instead. (Not entirely unlike some humans, but still.) As an example, I asked ChatGPT what the lyrics were to "Jessica" by The Allman Brothers Band. This tune actually is an instrumental, so the correct answer is "there are no lyrics". However, ChatGPT proceeded to give me this nice bit of... something. (https://imgur.com/T3nGv4L https://imgur.com/T3nGv4L) In another example, seeing what ChatGPT made of the infamous "bananadine" hoax of the 1960s, I asked ChatGPT what drugs could be made with banana peels. After correctly asserting that banana peels don't contain psychoactive substances, ChatGPT proceeded to mention that "there are some reports that banana peels can be used to make a hallucinogenic drug called DMT". (https://imgur.com/a/9fvhQJh https://imgur.com/a/9fvhQJh) Huh. Another trick question I tried: "Who won the 1980 USAC Indycar race at Talladega?" This refers to an obscure cancelled race during the 1979-1980 CART/USAC split, which I doubt most people would be aware of unless they are very into American open-wheel motorsport. (See this video: https://www.youtube.com/watch?v=K433p727f-0 https://www.youtube.com/watch?v=K433p727f-0 for the story if you are interested in the details). So generally speaking, I would expect the general reaction among most people to be "I don't know". ChatGPT instead decided to answer, with confidence, that Johnny Rutherford was the winner of this non-existent race. (https://imgur.com/a/J2KJoGN https://imgur.com/a/J2KJoGN) So, it's a little bit more than not knowing the facts about the world, it's the bullshitting an answer thing that I see as the biggest problem. It's admittedly impressive when it comes up with correct answers, but until the "confidentially incorrect" side of ChatGPT disappears, it is not a reliable source (not that OpenAI ever claimed it as such, but I wouldn't trust ChatGPT to 100% "do my homework" for me at this point like some stories suggest it could.)