7 ms·

> Everyone knows. Well as one of my social circle's nerds with tenure, most of the questions about <AI/ML flavour of the month> I hear relate to their degree o

by zdkl 5y ago

> Everyone knows. Well as one of my social circle's nerds with tenure, most of the questions about <AI/ML flavour of the month> I hear relate to their degree of agency/intelligence. So it may not be a novel statement that GPT-3 isn't intelligent but it is good to have references for the claim.

rytill 5y ago
I can agree with that.
machinelearning 5y ago
I'd challenge the premise instead of trying to claim that it's one way or another. Asking the question of whether something is intelligent always strikes me as odd. We don't have a definition of what intelligence is and our best guess in determining whether something is intelligent is to use the Turing test, which is highly subjective and doesn't bring us any closer to defining it. I think its far more productive to ask the question of what technology like this can realistically do for us instead of debating whether its intelligent or not.
zarzavat 5y ago
What GPT-3 lacks that seems to be crucial, is a consistent view of the world. For example, if you ask me "what is the capital of France?" I will answer "Paris" with 100% probability. No matter how you phrase the question, there is simply no other answer that can be given, if I understand what you are asking. It turns out that humans, despite their reputation, are actually very good at avoiding cognitive dissonance. Whereas language models are very bad at it. We don't even think of GPT-3 as having cognitive dissonance because there is not a gram of consonance in there.
- labster 5y ago
  > For example, if you ask me "what is the capital of France?" I will answer "Paris" with 100% probability. No matter how you phrase the question, there is simply no other answer that can be given, if I understand what you are asking. Context matters too. I could say “the letter F” is the capital of France, and it’s also true but not what you wanted. Maybe that’s why GPT-3 is so funny occasionally. Comedians are professionals in cognitive dissonance, and every once in a while the million monkeys of the algorithm hit comedy gold.
  - xarope 5y ago
    With some crosswords I do, F would be the Capital of France... or Euro (depending on era, perhaps the franc)
- AlotOfReading 5y ago
  There are certainly contexts in which that question can be answered differently. Say the actual question was "what is the [cheese] capital of France?", where the word is simply evident contextually. It's more than having a consistent view of the world, you have fundamentally better conceptual understanding that allow you to generalize the idea of political capitals to something unrelated like cheese and still understand the question. You also have a mental model of what the other person is thinking, so you know that "capital" probably isn't talking about cheese. GPT-3 doesn't have the former, and only knows the latter by statistical inference.
  - visarga 5y ago
    GPT-3 thinks "Brie is the cheese capital of France"
- hackinthebochs 5y ago
  The thing is, GPT-3 isn't a fact database, it's a story teller. So depending on how you phrase the input, it may tell you vastly different stories. There's no reason to expect it to reference the fact that Paris is the capital of France consistently in every story iteration.
- shahar2k 5y ago
  so if we're talking about raising capital, as well as capital returns, and capital markets and then I ask so what's the capital of france?....
- visarga 5y ago
  > if you ask me "what is the capital of France?" I will answer "Paris" with 100% probability. No matter how you phrase the question, there is simply no other answer that can be given There are many capitals of France, depending on time period: https://en.wikipedia.org/wiki/List_of_capitals_of_France https://en.wikipedia.org/wiki/List_of_capitals_of_France
  - adwn 5y ago
    > depending on time period It is evident to any human that the question includes an implied "right now" temporal qualifier. You've just failed the Turing test ;-)
    - visarga 5y ago
      But won the devil's advocate test instead.
    - PeterisP 5y ago
      I would say that the implied modifier applies to that particular phrasing, but "No matter how you phrase the question" presumes a wide variety of options where the implications may be very different.
- anfelor 5y ago
  If you ask people what the capitals of Turkey and Australia are, you might hear Istanbul and Sydney surprisingly often. There seems to be some probabilistic inference in our brain that the largest city in a country should also be the capital.
  - PeterisP 5y ago
    On the other hand, if you ask the same person what the capital of Turkey is in a hundred different ways, you'll get the same answer (though possibly mistaken) at all times. They may have a wrong internal model of country capitals, but all language communication works with the same model; while a GPT-3 like model approaches each question with a separate probabilistic interference without attempting to "make up its mind" about some internally consistent "mental model", which is probably one of the key gaps that needs fixing to bring it up a level.

by zdkl 5y ago

rytill 5y ago

I can agree with that.

machinelearning 5y ago

I'd challenge the premise instead of trying to claim that it's one way or another. Asking the question of whether something is intelligent always strikes me as odd. We don't have a definition of what intelligence is and our best guess in determining whether something is intelligent is to use the Turing test, which is highly subjective and doesn't bring us any closer to defining it. I think its far more productive to ask the question of what technology like this can realistically do for us instead of debating whether its intelligent or not.

zarzavat 5y ago

What GPT-3 lacks that seems to be crucial, is a consistent view of the world. For example, if you ask me "what is the capital of France?" I will answer "Paris" with 100% probability. No matter how you phrase the question, there is simply no other answer that can be given, if I understand what you are asking. It turns out that humans, despite their reputation, are actually very good at avoiding cognitive dissonance. Whereas language models are very bad at it. We don't even think of GPT-3 as having cognitive dissonance because there is not a gram of consonance in there.

labster 5y ago
> For example, if you ask me "what is the capital of France?" I will answer "Paris" with 100% probability. No matter how you phrase the question, there is simply no other answer that can be given, if I understand what you are asking. Context matters too. I could say “the letter F” is the capital of France, and it’s also true but not what you wanted. Maybe that’s why GPT-3 is so funny occasionally. Comedians are professionals in cognitive dissonance, and every once in a while the million monkeys of the algorithm hit comedy gold.
- xarope 5y ago
  With some crosswords I do, F would be the Capital of France... or Euro (depending on era, perhaps the franc)
AlotOfReading 5y ago
There are certainly contexts in which that question can be answered differently. Say the actual question was "what is the [cheese] capital of France?", where the word is simply evident contextually. It's more than having a consistent view of the world, you have fundamentally better conceptual understanding that allow you to generalize the idea of political capitals to something unrelated like cheese and still understand the question. You also have a mental model of what the other person is thinking, so you know that "capital" probably isn't talking about cheese. GPT-3 doesn't have the former, and only knows the latter by statistical inference.
- visarga 5y ago
  GPT-3 thinks "Brie is the cheese capital of France"
hackinthebochs 5y ago
The thing is, GPT-3 isn't a fact database, it's a story teller. So depending on how you phrase the input, it may tell you vastly different stories. There's no reason to expect it to reference the fact that Paris is the capital of France consistently in every story iteration.
shahar2k 5y ago
so if we're talking about raising capital, as well as capital returns, and capital markets and then I ask so what's the capital of france?....
visarga 5y ago
> if you ask me "what is the capital of France?" I will answer "Paris" with 100% probability. No matter how you phrase the question, there is simply no other answer that can be given There are many capitals of France, depending on time period: https://en.wikipedia.org/wiki/List_of_capitals_of_France https://en.wikipedia.org/wiki/List_of_capitals_of_France
- adwn 5y ago
  > depending on time period It is evident to any human that the question includes an implied "right now" temporal qualifier. You've just failed the Turing test ;-)
  - visarga 5y ago
    But won the devil's advocate test instead.
  - PeterisP 5y ago
    I would say that the implied modifier applies to that particular phrasing, but "No matter how you phrase the question" presumes a wide variety of options where the implications may be very different.
anfelor 5y ago
If you ask people what the capitals of Turkey and Australia are, you might hear Istanbul and Sydney surprisingly often. There seems to be some probabilistic inference in our brain that the largest city in a country should also be the capital.
- PeterisP 5y ago
  On the other hand, if you ask the same person what the capital of Turkey is in a hundred different ways, you'll get the same answer (though possibly mistaken) at all times. They may have a wrong internal model of country capitals, but all language communication works with the same model; while a GPT-3 like model approaches each question with a separate probabilistic interference without attempting to "make up its mind" about some internally consistent "mental model", which is probably one of the key gaps that needs fixing to bring it up a level.