4 ms·

> Does this prove ChatGPT and Bard can't think? None of them can. This test might show that it's better at predicting the correct output, that doesn't mean it

> Does this prove ChatGPT and Bard can't think? None of them can. This test might show that it's better at predicting the correct output, that doesn't mean it can think. When I run it with GPT-4 (very, very similar to bing if not the same) I get the correct answer and the explanation "This is a common joke format that plays on the idea of extrapolation, or the ability to predict or infer something based on existing data or information..." I think this shows rather well why it's so good at predicting the correct answer - it's a common joke it's seen many times. This is like how you "know" 1+1=2, you don't do any mental computation, you've memorized it. Interestingly, training LLM's with code seems to improve their "logic" abilities. EDIT: Something I think is funny: People are sharing their "test prompts" along with the answers everywhere... Where they'll inevitably get added to training data, allowing the LLM's to pass the tests, not because they can "do logic" but because they've already seen the answers. Most people's tests are relatively similar to each other which will let it extrapolate there too. EDIT2: This is really what we're talking about - https://en.wikipedia.org/wiki/Chinese_room https://en.wikipedia.org/wiki/Chinese_room

jstx1 3y ago
> None of them can. As the quality of the output improves, this distinction becomes meaningless.
- thewataccount 3y ago
  When it can do arbitrary math (without agents) such as (923042334+234234)/5 then I'll be impressed. Anyways this is really what we're discussing which is indeed interesting https://en.wikipedia.org/wiki/Chinese_room https://en.wikipedia.org/wiki/Chinese_room
  - deleted 3y ago
    [deleted]
  - deleted 3y ago
    [deleted]
labrador 3y ago
> None of them can Yes, but does it prove it?
- thewataccount 3y ago
  Checkout the Chinese Room thought experiment, in essence - you can't really prove it either way, the argument becomes what is the definition of thought. Mass-memorization to the point of passing as logic/thought may or may not count as actual thought. I'm in the camp that until it can do arbitrary math like (23942+323432)/5 without an agent then it's not capable of thought. I'll admit it's ability to program, and that training it to code also improves it's "english/human language" logic is interesting.
  - sharemywin 3y ago
    They might have already added agents behind the scenes or maybe you just need to ask it give you the exact answer. I don't know. ChatGPT4 USER I you needed to get the exact answer to this problem how would you approach this? (23942+323432)/5 ASSISTANT To get the exact answer for this problem, follow these steps: 1. Add the two numbers: 23942 + 323432 = 347374 2. Divide the sum by 5: 347374 ÷ 5 = 69474.8 ChatGPT3.5: USER I you needed to get the exact answer to this problem how would you approach this? (23942+323432)/5 ASSISTANT To get the exact answer to this problem, you would perform the following steps: 1. Add 23942 and 323432: 23942 + 323432 = 347374 2. Divide the result by 5: 347374 / 5 = 69474.8 Therefore, the exact answer to the problem (23942+323432)/5 is 69474.8. when I ask 3.5 this: USER what is the answer to (23942+323432)/5? ASSISTANT The answer is 68974.
    - thewataccount 3y ago
      Woah I think you're right. It's output looks suspiciously like Chain of thought too https://arxiv.org/abs/2304.03262 https://arxiv.org/abs/2304.03262 Here's a question - do we consider the intelligence of the model itself, or do we consider the possible intelligence of the entire system including agents? Because yeah if it can decide when it should chain stuff together then it's getting interesting.
sharemywin 3y ago
To me it has better reasoning abilities than some humans and since it doesn't have a silent voice it needs it to happen in the answer. What animals don’t have paws or lay eggs, but have wings? please think about this step by step ChatGPT Sure, I can help you think through this question step by step. First, let's start with the requirement that the animal should have wings. This immediately eliminates most mammals, such as cats, dogs, and horses, as they do not have wings. Birds are the first animals that come to mind when we think of animals with wings, but there are also insects, bats, and some reptiles that have wings. Now, let's move on to the requirement that the animal should not have paws. Paws are typically associated with mammals, so we can eliminate most mammals from consideration. However, some birds and reptiles have appendages that are similar to paws, such as talons or claws, which they use for grasping and climbing. Bats also have wings with fingers that can be used for grasping, but they are still classified as paws. Therefore, we should focus on animals that do not have grasping appendages like paws or talons. Lastly, we need to eliminate animals that lay eggs. This eliminates most birds, as they lay eggs. However, there are still some birds that do not lay eggs, such as cuckoos and megapodes, which incubate their eggs outside of their bodies. Most insects also lay eggs, so we should focus on the remaining options. Putting all of this together, the answer to the original question would be: bats. Bats have wings, but they do not have paws in the traditional sense, as their wings are adapted for flight rather than grasping. Additionally, bats do not lay eggs, but give birth to live young. Therefore, bats are the animals that meet all of the criteria specified in the question.

jstx1 3y ago

> None of them can. As the quality of the output improves, this distinction becomes meaningless.

thewataccount 3y ago
When it can do arbitrary math (without agents) such as (923042334+234234)/5 then I'll be impressed. Anyways this is really what we're discussing which is indeed interesting https://en.wikipedia.org/wiki/Chinese_room https://en.wikipedia.org/wiki/Chinese_room
- deleted 3y ago
  [deleted]
- deleted 3y ago
  [deleted]

labrador 3y ago

> None of them can Yes, but does it prove it?

thewataccount 3y ago
Checkout the Chinese Room thought experiment, in essence - you can't really prove it either way, the argument becomes what is the definition of thought. Mass-memorization to the point of passing as logic/thought may or may not count as actual thought. I'm in the camp that until it can do arbitrary math like (23942+323432)/5 without an agent then it's not capable of thought. I'll admit it's ability to program, and that training it to code also improves it's "english/human language" logic is interesting.
- sharemywin 3y ago
  They might have already added agents behind the scenes or maybe you just need to ask it give you the exact answer. I don't know. ChatGPT4 USER I you needed to get the exact answer to this problem how would you approach this? (23942+323432)/5 ASSISTANT To get the exact answer for this problem, follow these steps: 1. Add the two numbers: 23942 + 323432 = 347374 2. Divide the sum by 5: 347374 ÷ 5 = 69474.8 ChatGPT3.5: USER I you needed to get the exact answer to this problem how would you approach this? (23942+323432)/5 ASSISTANT To get the exact answer to this problem, you would perform the following steps: 1. Add 23942 and 323432: 23942 + 323432 = 347374 2. Divide the result by 5: 347374 / 5 = 69474.8 Therefore, the exact answer to the problem (23942+323432)/5 is 69474.8. when I ask 3.5 this: USER what is the answer to (23942+323432)/5? ASSISTANT The answer is 68974.
  - thewataccount 3y ago
    Woah I think you're right. It's output looks suspiciously like Chain of thought too https://arxiv.org/abs/2304.03262 https://arxiv.org/abs/2304.03262 Here's a question - do we consider the intelligence of the model itself, or do we consider the possible intelligence of the entire system including agents? Because yeah if it can decide when it should chain stuff together then it's getting interesting.

sharemywin 3y ago

To me it has better reasoning abilities than some humans and since it doesn't have a silent voice it needs it to happen in the answer. What animals don’t have paws or lay eggs, but have wings? please think about this step by step ChatGPT Sure, I can help you think through this question step by step. First, let's start with the requirement that the animal should have wings. This immediately eliminates most mammals, such as cats, dogs, and horses, as they do not have wings. Birds are the first animals that come to mind when we think of animals with wings, but there are also insects, bats, and some reptiles that have wings. Now, let's move on to the requirement that the animal should not have paws. Paws are typically associated with mammals, so we can eliminate most mammals from consideration. However, some birds and reptiles have appendages that are similar to paws, such as talons or claws, which they use for grasping and climbing. Bats also have wings with fingers that can be used for grasping, but they are still classified as paws. Therefore, we should focus on animals that do not have grasping appendages like paws or talons. Lastly, we need to eliminate animals that lay eggs. This eliminates most birds, as they lay eggs. However, there are still some birds that do not lay eggs, such as cuckoos and megapodes, which incubate their eggs outside of their bodies. Most insects also lay eggs, so we should focus on the remaining options. Putting all of this together, the answer to the original question would be: bats. Bats have wings, but they do not have paws in the traditional sense, as their wings are adapted for flight rather than grasping. Additionally, bats do not lay eggs, but give birth to live young. Therefore, bats are the animals that meet all of the criteria specified in the question.