4 ms·

None of what you say is incompatible with GPT being able to understand these concepts a few generations down the line. I mean, your central point is that GPT c

None of what you say is incompatible with GPT being able to understand these concepts a few generations down the line. I mean, your central point is that GPT could not possibly understand these concepts because it only perceived them from text, not real life, but... that's kind of true of people too? I can make observations and guesses about New York, even though I've never been in the US in my life. I can try to understand the hardships faced by minorities, even though I have never suffered from race or gender-based discrimination. A huge part of everything we know about the world around us comes from information we got from Wikipedia, or TV shows, or Youtube. It's information GPT could be trained on. You can always make a philosophical argument that even GPT-6 won't "really" what it's saying, but we have yet to see what the upper bound of GPT is given enough computing power. I'd expect most non-philosophical predictions about it can't do to be falsified within a few years.

mjburgess 5y ago
GPT has no body. It's not a matter of computing power. In every case where we estimate the meaning of words we do so in reference to prior concepts learnt by being in the world. We don't acquire language by watching videos; we watch videos when we have acquired language. > about it can't do to be falsified within a few years Such claims have been made since the 1940s, minskey said self-driving cars were a summer project. AI systems have never acquired what i'm talking about. Ever.
- PoignardAzur 5y ago
  > Such claims have been made since the 1940s, minskey said self-driving cars were a summer project. > AI systems have never acquired what i'm talking about. Ever. Well then, I dare you to make falsifiable claims, and we'll see in a few years how things pan out. =D
  - mjburgess 5y ago
    There will be no cars which can drive themselves around cities, as competently as human beings, this century. https://en.wikipedia.org/wiki/AI_winter https://en.wikipedia.org/wiki/AI_winter

mjburgess 5y ago

GPT has no body. It's not a matter of computing power. In every case where we estimate the meaning of words we do so in reference to prior concepts learnt by being in the world. We don't acquire language by watching videos; we watch videos when we have acquired language. > about it can't do to be falsified within a few years Such claims have been made since the 1940s, minskey said self-driving cars were a summer project. AI systems have never acquired what i'm talking about. Ever.

PoignardAzur 5y ago
> Such claims have been made since the 1940s, minskey said self-driving cars were a summer project. > AI systems have never acquired what i'm talking about. Ever. Well then, I dare you to make falsifiable claims, and we'll see in a few years how things pan out. =D
- mjburgess 5y ago
  There will be no cars which can drive themselves around cities, as competently as human beings, this century. https://en.wikipedia.org/wiki/AI_winter https://en.wikipedia.org/wiki/AI_winter