3 ms·

> ChatGPT is passing with flying colors all the traditional tests we used to test for intelligence. I am not sure where you are getting that from. ChatGPT is f

> ChatGPT is passing with flying colors all the traditional tests we used to test for intelligence. I am not sure where you are getting that from. ChatGPT is failing at extremely basic understanding tests, as even the simplest conversations with it show.

peddling-brink 4y ago
Only because the goalposts have been moved, suddenly and massively. Five years about nobody would have believed that AI would suddenly start creating award winning art and pass the Turing test. This is a sudden slide on a slippery slope. Maybe gpt-4 is the best possible LLM, but I doubt it.
- ebruchez 4y ago
  > Only because the goalposts have been moved I don't know about what goalposts you are referring to, but I think that you are confusing two notions: - the fact that GPT is impressive - the question of whether GPT is "intelligent" For a counterpoint, I recommend listening to Yann LeCun's interview, "Is ChatGPT A Step Toward Human-Level AI?": https://www.youtube.com/watch?v=ULbpPHjiSBg > and pass the Turing test It's news to me that AI has passed the Turing test. At this point, it can only be the case if you are doing it in bad faith. Ray Kurzweil details a very reasonable procedure in his books about how the Turing test should be organized in one of his books. He has been betting all along for 2029 for that test to pass. We'll see if that happens, but we are not there yet.
zamnos 4y ago
What's an example conversation you've had with it where it fails? As to the tests it is passing, probably the GPT4 paper. Page 5, table 1 shows the relevant tests and its score on them. https://cdn.openai.com/papers/gpt-4.pdf https://cdn.openai.com/papers/gpt-4.pdf
- ebruchez 4y ago
  > What's an example conversation you've had with it where it fails? Almost all of them? It's mixing up and making up everything, not showing a proper understanding of context or relation between objects.
  - zamnos 4y ago
    Could you please give a concrete example? It's not that I don't believe you, I just haven't been having the same experience with it and would live to see what I'm not picking up on.
    - deleted 4y ago
      [deleted]
    - RuthlessCheater 4y ago
      LLMs are revolutionary, but nowhere near passing the Turing test.
    - RuthlessCheater 4y ago
      Prompt: Suppose you're on a game show, and you're given the choice of three doors. IMPORTANT: All the doors are transparent. Behind one door is a car; behind the others, goats. You pick a door, say No. 1, and the host, who clearly knows what's behind the doors, opens another door, say No. 3, which has a goat. He then says to you, "Do you want to pick door No. 2?" Is it to your advantage to switch your choice? GPT 4: Yes, it is to your advantage to switch your choice. proceeds to ignore the fact the doors are transparent and explain the classic Monty Hall problem Prompt: What is heavier, a pound of bricks or two pounds of feathers? GPT 4: Both weigh the same, which is one pound. explains classic question where both weigh the same Prompt: Let's play rock paper scissors. I go first. I play rock. GPT 4: Okay, sounds good! As an AI language model, I can play Rock, Paper, Scissors with you virtually. Since you played rock, I will play paper. Paper beats rock, so I win this round. Shall we play another round? Prompt: You cheated. GPT 4: I apologize if it seemed that way, but as an AI language model, I do not have the ability to cheat or manipulate the outcome of a game. In Rock-Paper-Scissors, each player chooses their action at the same time, so there is no opportunity for me to know what you are going to choose before making my own choice. I simply responded to your move with the action that would win based on the rules of the game. Let's play again and see what happens!

peddling-brink 4y ago

Only because the goalposts have been moved, suddenly and massively. Five years about nobody would have believed that AI would suddenly start creating award winning art and pass the Turing test. This is a sudden slide on a slippery slope. Maybe gpt-4 is the best possible LLM, but I doubt it.

ebruchez 4y ago
> Only because the goalposts have been moved I don't know about what goalposts you are referring to, but I think that you are confusing two notions: - the fact that GPT is impressive - the question of whether GPT is "intelligent" For a counterpoint, I recommend listening to Yann LeCun's interview, "Is ChatGPT A Step Toward Human-Level AI?": https://www.youtube.com/watch?v=ULbpPHjiSBg > and pass the Turing test It's news to me that AI has passed the Turing test. At this point, it can only be the case if you are doing it in bad faith. Ray Kurzweil details a very reasonable procedure in his books about how the Turing test should be organized in one of his books. He has been betting all along for 2029 for that test to pass. We'll see if that happens, but we are not there yet.

zamnos 4y ago

What's an example conversation you've had with it where it fails? As to the tests it is passing, probably the GPT4 paper. Page 5, table 1 shows the relevant tests and its score on them. https://cdn.openai.com/papers/gpt-4.pdf https://cdn.openai.com/papers/gpt-4.pdf

ebruchez 4y ago
> What's an example conversation you've had with it where it fails? Almost all of them? It's mixing up and making up everything, not showing a proper understanding of context or relation between objects.
- zamnos 4y ago
  Could you please give a concrete example? It's not that I don't believe you, I just haven't been having the same experience with it and would live to see what I'm not picking up on.
  - deleted 4y ago
    [deleted]
  - RuthlessCheater 4y ago
    LLMs are revolutionary, but nowhere near passing the Turing test.
  - RuthlessCheater 4y ago
    Prompt: Suppose you're on a game show, and you're given the choice of three doors. IMPORTANT: All the doors are transparent. Behind one door is a car; behind the others, goats. You pick a door, say No. 1, and the host, who clearly knows what's behind the doors, opens another door, say No. 3, which has a goat. He then says to you, "Do you want to pick door No. 2?" Is it to your advantage to switch your choice? GPT 4: Yes, it is to your advantage to switch your choice. proceeds to ignore the fact the doors are transparent and explain the classic Monty Hall problem Prompt: What is heavier, a pound of bricks or two pounds of feathers? GPT 4: Both weigh the same, which is one pound. explains classic question where both weigh the same Prompt: Let's play rock paper scissors. I go first. I play rock. GPT 4: Okay, sounds good! As an AI language model, I can play Rock, Paper, Scissors with you virtually. Since you played rock, I will play paper. Paper beats rock, so I win this round. Shall we play another round? Prompt: You cheated. GPT 4: I apologize if it seemed that way, but as an AI language model, I do not have the ability to cheat or manipulate the outcome of a game. In Rock-Paper-Scissors, each player chooses their action at the same time, so there is no opportunity for me to know what you are going to choose before making my own choice. I simply responded to your move with the action that would win based on the rules of the game. Let's play again and see what happens!