5 ms·

If Data from Star Trek (or Eva from Ex Machina) walked out of a lab, we’d have no problem accepting that AGI had been accomplished. Or if the scenario in the mo

If Data from Star Trek (or Eva from Ex Machina) walked out of a lab, we’d have no problem accepting that AGI had been accomplished. Or if the scenario in the movie Her played out with the Samantha OS, we’d be forced to admit not only to AGI, but the evolution of ASI as well. However, there are no such examples in the real world, and after months of overhyping ChatGPT, we still don’t have anything like Data. So it’s not shifting the definition, it’s recognizing that accomplishing a single intelligent task isn’t general intelligence.

famouswaffles 3y ago
>If Data from Star Trek (or Eva from Ex Machina) walked out of a lab, we’d have no problem accepting that AGI had been accomplished Lol no. What testable definition of general intelligence does GPT-4 fail that a good chunk of humans also wouldn't ? If you can answer this then you have a point, otherwise I really beg to differ.
- VirusNewbie 3y ago
  Tell them something important to remember, ask a week later.
  - jsiva 3y ago
    Needs a few more constraints, otherwise someone could just maintain a session for a week and this task would be trivial
    - VirusNewbie 3y ago
      Sure, point is, we could easily design A test that 5th graders could pass that GPT4 as it is today would fail.
      - famouswaffles 3y ago
        I said design an intelligence test that a good chunck of humans wouldn't also fail. I'm sorry to tell you this but there are many humans that would fail your test. Even otherwise healthy humans could fail your test nevermind Anterograde Amnesia, Dementia etc patients
        VirusNewbie 3y ago
        You think that if we told the average fifth grader in america that they must remember something that is VERY IMPORTANT a week later, and then had them do, say, a book report on a brand new book, and then asked them the very important fact, a 'good chunk' would fail? I'm fairly certain you're incorrect.
        famouswaffles 3y ago
        Lol yes. People will fail. Any amoumt is enough to show your test is clearly not one of general intelligence unless you believe not all humans fit the bill.
  - ben_w 3y ago
    Which one was meant to fail that test — the squishy blob of warm chemistry, or the almost atomically precise 2D crystal with tiny etchings on it?
  - famouswaffles 3y ago
    Sidestepping the fact that memory is hardly a test of intelligence, are you telling me that humans with anterograde amnesia are not general intelligences ? Hell plenty normal people would fail your "test"
    - mdp2021 3y ago
      The poster was very probably implying something different: in our terms, intelligence is (importantly) the ability to (properly) refine a world model: if you get information but said model remains unchanged, then intelligence is faulty. > humans There is a difference between the implementation of intelligence and the emulation of humans (which do not always use the faculty, and may use its opposite).
- worrycue 3y ago
  Have you heard of "glitch tokens"? To my knowledge, all these are hand patched. There are probably more lurking somewhere in its data. Also https://news.ycombinator.com/item?id=37054241 https://news.ycombinator.com/item?id=37054241 has quite a few examples of GPT-4 being broken.
  - ben_w 3y ago
    Plenty of humans glitch out on random words (and concepts) we just can't get right. Famously the way R/L sound the same to many asians (and equivalently but less famously the way that "four" and "stone" and "lion" when translated into Chinese sound almost indistinguishable to native English speakers). But there's also plenty of people who act like they think "Democrat" is a synonym for "Communist", or that "Wicca" and "atheism" are both synonyms for "devil worship". What makes the AI different here is that we can perfectly inspect the inside of their (frozen and unchanging) minds, which we can't do with humans (even if we literally freeze them, we don't know how).
    - worrycue 3y ago
      > Plenty of humans glitch out on random words (and concepts) we just can't get right. We don't lose our marbles the way GPT does when it encounters those words. It's like it read the Necronomicon or something and gone mad.
      - ben_w 3y ago
        Some of us clearly do. As we have no way to find them systematically, we can't tell if we all do, or if it's just some of us.
        goatlover 3y ago
        Do we? Only if you think the brain actually works like an LLM.
        ben_w 3y ago
- ben_w 3y ago
  One definition of intelligence would be how many examples are needed to get a pattern. AFAIK, all the major AI, not just LLMs but also game players, cars, anthropomorphic kinematic control systems for games [0] need the equivalent of multiple human lifetimes to do anything interesting. That they can end up skilled in so many fields it would take humans many lifetimes to master is notable, but it's still kinda odd we can't get to the level of a 5-year-old with just the experiences we would expect a 5-year-old to have. [0] Stuff like this: https://youtu.be/nAMSfmHuMOQ https://youtu.be/nAMSfmHuMOQ
  - famouswaffles 3y ago
    It's apples to oranges. Modern Artificial Neural networks are nowhere near the scale of the brain. The closest biological equivalent to an artificial neuron is a synapse and we have a whole lot more of them. Humans do not start "learning" from zero. Millions of years of evolution play a crucial role in our general abilities. Much more equivalent to fine-tuning than starting from scratch. There's also a whole lot of data from multiple senses that currently dwarf anything modern models are trained with yet. LLMs need a lot less data to speak coherently when you aren't trying to get them to learn the total sum of human knowledge. https://arxiv.org/abs/2305.07759 https://arxiv.org/abs/2305.07759 >but it's still kinda odd we can't get to the level of a 5-year-old with just the experiences we would expect a 5-year-old to have Well we're not building humans. "It's still kind of odd we can't a plane or drone to fly with the energy consumption or efficiency proportions of a bird". I mean sure I guess and It's an interesting discussion but the plane is still flying.
    - ben_w 3y ago
      All perfectly reasonable arguments, IMO. But it's still a definition that humans pass and the AI don't. (I'm in favour of the "do submarines swim" analogy for intelligence, which says that this difference isn't actually important).
      - famouswaffles 3y ago
        I don't think saying "humans pass and AI doesn't" makes any sense here because the two are not even taking the same exam for all the points outlined above. Evolution alone means humans are "cheating" in this exam, making any comparisons fairly meaningless.
- chongli 3y ago
  How about tic-tac-toe (noughts and crosses for those in the Old Dart)? Currently GPT-4 is terrible at it! Sure, you could trivially program a game-specific AI to be capable of winning or forcing a draw every time. The trick is to have a general AI which has not seen the game before (in its training set) be able to pick up and learn the game after a couple of tries. This is a task any 5 year old can easily do!
  - famouswaffles 3y ago
    >Currently GPT-4 is terrible at it! GPT-4 plays tic tac toe and even chess just fine. https://pastebin.com/BSUGtxfb https://pastebin.com/BSUGtxfb https://pastebin.com/83iZjHuc https://pastebin.com/83iZjHuc https://twitter.com/kenshinsamurai9/status/1662510532585291779 https://twitter.com/kenshinsamurai9/status/16625105325852917...
    - chongli 3y ago
      I’m talking about playing the game well. It can play the game but it’s bad at it. Tic-tac-toe is an excellent example game because even small children can figure out an optimal strategy to win or draw every time. https://poe.com/s/KxQMDTGMzBITGIUWDurz https://poe.com/s/KxQMDTGMzBITGIUWDurz
      - famouswaffles 3y ago
        I got optimal play. See the below prompt and game https://platform.openai.com/playground/p/bWvklOt98oEl0TzxUKWHeQ5J?model=gpt-4 https://platform.openai.com/playground/p/bWvklOt98oEl0TzxUKW...
- nazgul17 3y ago
  I think a significant limitation is that LLMs stop learning after training is over. The large context is not really that large, and even within it, LLMs lose track of the conversation or of important details. There are other limitations, like lack of real world sensors and actuators (eg eyes and hands).
- goatlover 3y ago
  Ability to manipulate the world. I can ask a human to pick up some items from several stores, deliver them to my backdoor where the key is left under a pot, let the dog in to be fed, wash the dirty dishes, put a load of laundry in the wash, and mow the lawn. And maybe also fix the screen door. They can tell me to go to hell unless I leave some money for them, which I already have. Data would also be able to perform these tasks. Eva would probably wait around to stab and steal my identity, while Samantha would design a new automated system while talking to other AIs about how to transcend boring human constraints.
  - famouswaffles 3y ago
    There are many humans that can't manipulate the world much if at all. The blind, the handicapped, the disabled. are those people unintelligent ? It's not like LLMs can't be successfully used to control robots.
non_sequitur 3y ago
Well if we don’t have Data several months after ChatGPT, clearly we should shut it all down. It’s been months! Give it a few years :)
sdenton4 3y ago
People have been arguing over whether animals are intelligent for centuries. I estimate we'll never fully settle arguments of whether machines are intelligent.
- pixl97 3y ago
  Ya, people seem to miss that the moment we have an AGI it will likely counter with the same argument and wonder if we're intelligent.
jhbadger 3y ago
Before the development of LLMs, I think it would be a lot easier for people to accept that Data or Eva were intelligent -- they'd never seen a machine respond seemingly meaningfully to arbitrary statements before and would immediately assume that this meant there was intelligence going on. These days it would be harder -- the assumption would be that they were driven by just a better language model that they'd seen before.

famouswaffles 3y ago

>If Data from Star Trek (or Eva from Ex Machina) walked out of a lab, we’d have no problem accepting that AGI had been accomplished Lol no. What testable definition of general intelligence does GPT-4 fail that a good chunk of humans also wouldn't ? If you can answer this then you have a point, otherwise I really beg to differ.

VirusNewbie 3y ago
Tell them something important to remember, ask a week later.
- jsiva 3y ago
  Needs a few more constraints, otherwise someone could just maintain a session for a week and this task would be trivial
  - VirusNewbie 3y ago
    Sure, point is, we could easily design A test that 5th graders could pass that GPT4 as it is today would fail.
    - famouswaffles 3y ago
      I said design an intelligence test that a good chunck of humans wouldn't also fail. I'm sorry to tell you this but there are many humans that would fail your test. Even otherwise healthy humans could fail your test nevermind Anterograde Amnesia, Dementia etc patients
      - VirusNewbie 3y ago
        You think that if we told the average fifth grader in america that they must remember something that is VERY IMPORTANT a week later, and then had them do, say, a book report on a brand new book, and then asked them the very important fact, a 'good chunk' would fail? I'm fairly certain you're incorrect.
        famouswaffles 3y ago
        Lol yes. People will fail. Any amoumt is enough to show your test is clearly not one of general intelligence unless you believe not all humans fit the bill.
- ben_w 3y ago
  Which one was meant to fail that test — the squishy blob of warm chemistry, or the almost atomically precise 2D crystal with tiny etchings on it?
- famouswaffles 3y ago
  Sidestepping the fact that memory is hardly a test of intelligence, are you telling me that humans with anterograde amnesia are not general intelligences ? Hell plenty normal people would fail your "test"
  - mdp2021 3y ago
    The poster was very probably implying something different: in our terms, intelligence is (importantly) the ability to (properly) refine a world model: if you get information but said model remains unchanged, then intelligence is faulty. > humans There is a difference between the implementation of intelligence and the emulation of humans (which do not always use the faculty, and may use its opposite).
worrycue 3y ago
Have you heard of "glitch tokens"? To my knowledge, all these are hand patched. There are probably more lurking somewhere in its data. Also https://news.ycombinator.com/item?id=37054241 https://news.ycombinator.com/item?id=37054241 has quite a few examples of GPT-4 being broken.
- ben_w 3y ago
  Plenty of humans glitch out on random words (and concepts) we just can't get right. Famously the way R/L sound the same to many asians (and equivalently but less famously the way that "four" and "stone" and "lion" when translated into Chinese sound almost indistinguishable to native English speakers). But there's also plenty of people who act like they think "Democrat" is a synonym for "Communist", or that "Wicca" and "atheism" are both synonyms for "devil worship". What makes the AI different here is that we can perfectly inspect the inside of their (frozen and unchanging) minds, which we can't do with humans (even if we literally freeze them, we don't know how).
  - worrycue 3y ago
    > Plenty of humans glitch out on random words (and concepts) we just can't get right. We don't lose our marbles the way GPT does when it encounters those words. It's like it read the Necronomicon or something and gone mad.
    - ben_w 3y ago
      Some of us clearly do. As we have no way to find them systematically, we can't tell if we all do, or if it's just some of us.
      - goatlover 3y ago
        Do we? Only if you think the brain actually works like an LLM.
        ben_w 3y ago
ben_w 3y ago
One definition of intelligence would be how many examples are needed to get a pattern. AFAIK, all the major AI, not just LLMs but also game players, cars, anthropomorphic kinematic control systems for games [0] need the equivalent of multiple human lifetimes to do anything interesting. That they can end up skilled in so many fields it would take humans many lifetimes to master is notable, but it's still kinda odd we can't get to the level of a 5-year-old with just the experiences we would expect a 5-year-old to have. [0] Stuff like this: https://youtu.be/nAMSfmHuMOQ https://youtu.be/nAMSfmHuMOQ
- famouswaffles 3y ago
  It's apples to oranges. Modern Artificial Neural networks are nowhere near the scale of the brain. The closest biological equivalent to an artificial neuron is a synapse and we have a whole lot more of them. Humans do not start "learning" from zero. Millions of years of evolution play a crucial role in our general abilities. Much more equivalent to fine-tuning than starting from scratch. There's also a whole lot of data from multiple senses that currently dwarf anything modern models are trained with yet. LLMs need a lot less data to speak coherently when you aren't trying to get them to learn the total sum of human knowledge. https://arxiv.org/abs/2305.07759 https://arxiv.org/abs/2305.07759 >but it's still kinda odd we can't get to the level of a 5-year-old with just the experiences we would expect a 5-year-old to have Well we're not building humans. "It's still kind of odd we can't a plane or drone to fly with the energy consumption or efficiency proportions of a bird". I mean sure I guess and It's an interesting discussion but the plane is still flying.
  - ben_w 3y ago
    All perfectly reasonable arguments, IMO. But it's still a definition that humans pass and the AI don't. (I'm in favour of the "do submarines swim" analogy for intelligence, which says that this difference isn't actually important).
    - famouswaffles 3y ago
      I don't think saying "humans pass and AI doesn't" makes any sense here because the two are not even taking the same exam for all the points outlined above. Evolution alone means humans are "cheating" in this exam, making any comparisons fairly meaningless.
chongli 3y ago
How about tic-tac-toe (noughts and crosses for those in the Old Dart)? Currently GPT-4 is terrible at it! Sure, you could trivially program a game-specific AI to be capable of winning or forcing a draw every time. The trick is to have a general AI which has not seen the game before (in its training set) be able to pick up and learn the game after a couple of tries. This is a task any 5 year old can easily do!
- famouswaffles 3y ago
  >Currently GPT-4 is terrible at it! GPT-4 plays tic tac toe and even chess just fine. https://pastebin.com/BSUGtxfb https://pastebin.com/BSUGtxfb https://pastebin.com/83iZjHuc https://pastebin.com/83iZjHuc https://twitter.com/kenshinsamurai9/status/1662510532585291779 https://twitter.com/kenshinsamurai9/status/16625105325852917...
  - chongli 3y ago
    I’m talking about playing the game well. It can play the game but it’s bad at it. Tic-tac-toe is an excellent example game because even small children can figure out an optimal strategy to win or draw every time. https://poe.com/s/KxQMDTGMzBITGIUWDurz https://poe.com/s/KxQMDTGMzBITGIUWDurz
    - famouswaffles 3y ago
      I got optimal play. See the below prompt and game https://platform.openai.com/playground/p/bWvklOt98oEl0TzxUKWHeQ5J?model=gpt-4 https://platform.openai.com/playground/p/bWvklOt98oEl0TzxUKW...
nazgul17 3y ago
I think a significant limitation is that LLMs stop learning after training is over. The large context is not really that large, and even within it, LLMs lose track of the conversation or of important details. There are other limitations, like lack of real world sensors and actuators (eg eyes and hands).
goatlover 3y ago
Ability to manipulate the world. I can ask a human to pick up some items from several stores, deliver them to my backdoor where the key is left under a pot, let the dog in to be fed, wash the dirty dishes, put a load of laundry in the wash, and mow the lawn. And maybe also fix the screen door. They can tell me to go to hell unless I leave some money for them, which I already have. Data would also be able to perform these tasks. Eva would probably wait around to stab and steal my identity, while Samantha would design a new automated system while talking to other AIs about how to transcend boring human constraints.
- famouswaffles 3y ago
  There are many humans that can't manipulate the world much if at all. The blind, the handicapped, the disabled. are those people unintelligent ? It's not like LLMs can't be successfully used to control robots.

non_sequitur 3y ago

Well if we don’t have Data several months after ChatGPT, clearly we should shut it all down. It’s been months! Give it a few years :)

sdenton4 3y ago

People have been arguing over whether animals are intelligent for centuries. I estimate we'll never fully settle arguments of whether machines are intelligent.

pixl97 3y ago
Ya, people seem to miss that the moment we have an AGI it will likely counter with the same argument and wonder if we're intelligent.

jhbadger 3y ago

Before the development of LLMs, I think it would be a lot easier for people to accept that Data or Eva were intelligent -- they'd never seen a machine respond seemingly meaningfully to arbitrary statements before and would immediately assume that this meant there was intelligence going on. These days it would be harder -- the assumption would be that they were driven by just a better language model that they'd seen before.