4 ms·

LLM doesn't pick some results because LLM is smart, it picks results because it's trained. So analogy with a horse is valid.

kazinator 4y ago
Writing programs requires an education. You can sort of fake it with training, if you're a machine that can train on a billion examples and reliably retain something from each one, without understanding any of them.
- fl7305 4y ago
  So your claim is that GPT-4 is a stochastic parrot? Meanwhile, the creators at OpenAI claims that it is not. How do we test your claim? What are the logical reasoning questions we can ask GPT-4 that it shouldn't be able to answer if it's just a stochastic parrot? I keep asking people this, but so far no one has answered. Is the claim a personal belief that you don't want to discuss, similar to your religious beliefs? If so, fine, but please make it clear that you're not making a scientific claim.
  - kazinator 4y ago
    GPT-4 looks like a much more powerful system which can produce answers in ways that can't easily be explained/dismissed as "stochastic parroting".
travisjungroth 4y ago
You don’t get the horse analogy. The horse isn’t trained to count to eight. The horse is trained to stomp continuously. The performer yells “stop” at eight. It’s a carnival trick and a form of cherry-picking. The commenter was saying that ChatGPT doesn’t have the ability to solve these problems at all and people are just choosing the randomly correct answers. I think this is obviously not true.
- kazinator 4y ago
  The purpose of the horse analogy wasn't so much to equate ChatGPT to a horse that just stomps, but the behavior of the humans around it who believe that it can count. This can be the naive trainer too, who doesn't recognize that he's subconsciously cuing the horse. He has a confirmation bias whereby he or she rejects any evidence refuting the hypothesis that the horse cannot count. There is a difference between solving and problem and presenting a solution, and that difference doesn't hinge on whether the solution is correct.
  - travisjungroth 4y ago
    ChatGPT is making me realize how completely differently I see the concepts of knowledge and ability from so many people.

kazinator 4y ago

Writing programs requires an education. You can sort of fake it with training, if you're a machine that can train on a billion examples and reliably retain something from each one, without understanding any of them.

fl7305 4y ago
So your claim is that GPT-4 is a stochastic parrot? Meanwhile, the creators at OpenAI claims that it is not. How do we test your claim? What are the logical reasoning questions we can ask GPT-4 that it shouldn't be able to answer if it's just a stochastic parrot? I keep asking people this, but so far no one has answered. Is the claim a personal belief that you don't want to discuss, similar to your religious beliefs? If so, fine, but please make it clear that you're not making a scientific claim.
- kazinator 4y ago
  GPT-4 looks like a much more powerful system which can produce answers in ways that can't easily be explained/dismissed as "stochastic parroting".

travisjungroth 4y ago

You don’t get the horse analogy. The horse isn’t trained to count to eight. The horse is trained to stomp continuously. The performer yells “stop” at eight. It’s a carnival trick and a form of cherry-picking. The commenter was saying that ChatGPT doesn’t have the ability to solve these problems at all and people are just choosing the randomly correct answers. I think this is obviously not true.

kazinator 4y ago
The purpose of the horse analogy wasn't so much to equate ChatGPT to a horse that just stomps, but the behavior of the humans around it who believe that it can count. This can be the naive trainer too, who doesn't recognize that he's subconsciously cuing the horse. He has a confirmation bias whereby he or she rejects any evidence refuting the hypothesis that the horse cannot count. There is a difference between solving and problem and presenting a solution, and that difference doesn't hinge on whether the solution is correct.
- travisjungroth 4y ago
  ChatGPT is making me realize how completely differently I see the concepts of knowledge and ability from so many people.