3 ms·

Humans can self correct / think critically. AIs like ChatGPT can’t do that at all. You know sometimes you have a “bright idea” then after thinking about it for

Humans can self correct / think critically. AIs like ChatGPT can’t do that at all. You know sometimes you have a “bright idea” then after thinking about it for a second you realise it’s nonsense. With AI like ChatGPT, the “thinking about it for a second” part never happens.

zamnos 4y ago
There are logs where ChatGPT initially gives the wrong answer, but then corrects itself when asked to explain the wrong answer. Is that the second part you're thinking of?
- danparsonson 4y ago
  The crucial difference there is the presence of an external agent intelligent enough to spot that the answer is wrong; humans can do that for themselves. ChatGPT doesn't self-reflect.
  - drusepth 4y ago
    Interestingly, many (most?) humans don't self-reflect or correct themselves unless challenged by an external agent as well — which doesn't necessarily have to be another human. Also of note, GPT-4 seems to show huge improvements so far over GPT-3 when it comes to "thinking out loud" to come to a (better) answer to more complex problems. Kind of a front-loaded reflection of correctness for an overall goal before diving into the implementation weeds — something that definitely helps me (as a human) avoid unnecessary mistakes in the first place.
    - danparsonson 4y ago
      > Interestingly, many (most?) humans don't self-reflect or correct themselves unless challenged by an external agent as well Disagree with you here - why do you say this? Maybe we don't apply self-reflection consistently (for example when it comes to political beliefs) but even toddlers know when they haven't achieved the goal they were aiming for. ChatGPT has no clue unless you prod it, because it doesn't know anything - it's stringing words together using probability.
- impalallama 4y ago
  ChatGPT will do the exact same thing with correct answers.

zamnos 4y ago

There are logs where ChatGPT initially gives the wrong answer, but then corrects itself when asked to explain the wrong answer. Is that the second part you're thinking of?

danparsonson 4y ago
The crucial difference there is the presence of an external agent intelligent enough to spot that the answer is wrong; humans can do that for themselves. ChatGPT doesn't self-reflect.
- drusepth 4y ago
  Interestingly, many (most?) humans don't self-reflect or correct themselves unless challenged by an external agent as well — which doesn't necessarily have to be another human. Also of note, GPT-4 seems to show huge improvements so far over GPT-3 when it comes to "thinking out loud" to come to a (better) answer to more complex problems. Kind of a front-loaded reflection of correctness for an overall goal before diving into the implementation weeds — something that definitely helps me (as a human) avoid unnecessary mistakes in the first place.
  - danparsonson 4y ago
    > Interestingly, many (most?) humans don't self-reflect or correct themselves unless challenged by an external agent as well Disagree with you here - why do you say this? Maybe we don't apply self-reflection consistently (for example when it comes to political beliefs) but even toddlers know when they haven't achieved the goal they were aiming for. ChatGPT has no clue unless you prod it, because it doesn't know anything - it's stringing words together using probability.
impalallama 4y ago
ChatGPT will do the exact same thing with correct answers.