4 ms·

Failures are proof, successes are not, a broken clock is right twice a day after all

• HervalFreire 4y ago
  So if a human fails at something it's proof that the human doesn't understand anything and that a human is a stochastic parrot? I think your clock analogy doesn't fit. A car with a broken mirror still runs.
  • Lewton 4y ago
    The output of GPT is “random” in a sense that output from humans are not. I can ask it logic puzzles and sometimes it’ll get the logic puzzle right by chance, and other times it won’t. I can’t use the times it gets the logic puzzle right, as evidence that it understood the puzzle. All of these blog posts that are popping up suffer from survivor bias, nobody is sharing blog posts of GPTs failures
    • HervalFreire 4y ago
      > I can’t use the times it gets the logic puzzle right, as evidence that it understood the puzzle. No this is bias from your end. It really depends on the puzzle. You need to give it a puzzle with trillions of possible answers. In this case if it gets a right answer even once the probability is so low for this to happen by chance that it means an aspect of the model understands the concept; While another aspect of the model doesn't understand it. It's possible for even humans to have contradictory thinking and desires. Therefore a claim cannot be made that it understands nothing.