4 ms·

What is it like to be an AGI?

17 points by korymath 4y ago

bcrl 4y ago
The Bobiverse books by Dennis E. Taylor touch upon this, as Bob is a human that becomes the AI in a replicant that is the intelligence behind a von Neumann probe sent out from earth. One of the ways that he maintains his sanity is to build a simulated VR environment to help maintain his sanity. I personally think that the really hard part in creating an AGI is going to be training. As an adult human, one can look at an object and instantly know what its texture is going to feel like on one's fingers or even lips, how it will bounce and if it will shatter. How did we gain that knowledge? As babies we put absolutely everything we saw into our mouths and sucked or chewed on it. As kids we played for hours on end with all kinds of toys and household objects. Coming up with a way of training an AGI to be human level will be hard, as there is such a vast scope of knowledge in "common sense" that will be exceedingly difficult to implant into an AGI without the AGI having an ability to interact with the real world. On the other hand, once that body of knowledge becomes an available training data set, evolution can take off at speeds otherwise impossible in the real world.
mint2 4y ago
AGI: Adjusted gross income? That didn’t make sense. Acronyms in headline are not the place to put them unless it’s very certain the target audience is innately familiar. Guess I’m not that audience.
- porknubbins 4y ago
  I agree, and stay in this world too long and all your acronyms will be overloaded. ISA is instruction set architecture ? Income sharing agreement? Especially when the headline poses a counterfactual/impossible question they should help as much as possible.
  - na85 4y ago
    >ISA How could you forget "Industry Standard Architecture", the bane of my youth? I once had an old 266 MHz pentium with an ISA network card that was just an absolute nightmare. This was when PCI was dominant and AGP graphics cards had not yet become mainstream, and I guess the ISA drivers just weren't being maintained for Win 98. I had to go into Control Panel and disable/re-enable the Ethernet adapter about three times an hour, because the connection would simply drop and that was the only rectification that I was savvy enough to attempt.
    - porknubbins 4y ago
      Right of course! I forgot it since its been so long, but I’ve certainly read about ISA, thought I think it was obsolete by thr time I was working inside computers.
bmn3267 4y ago
freakin' awesome most probably, if you're on the side of half full glass.
- jhbadger 4y ago
  It would depend on the legality of the situation -- like in Gibson's Neuromancer where a fully-intelligent AI has Swiss citizenship and yet the software and supercomputer it is running on is owned by a corporation -- “Like, I own your brain and what you know, but your thoughts have Swiss citizenship. Sure. Lotsa luck, AI.” as a character puts it.
jasfi 4y ago
This is projecting way too much of our own experience onto what is really just computer processing.
- ravi-delia 4y ago
  Everything that computes is probably "just computer processing". I wouldn't be shocked if enough translates that it's not totally useless
  - jasfi 4y ago
    Humans have consciousness, which seems like something else related to the physics of our universe. The article hints at AGI having consciousness, but I can't see how that kind of argument can be made.
    - ravi-delia 4y ago
      Ok, assuming consciousness is both reliant on physics we don't understand, and that physics selectively avoids so blessing any machine, you're correct. Is there evidence to support either of those things? Absolutely not.
      - jasfi 4y ago
        Why is consciousness in humans limited to our brains? We've never seen non-living material exhibit the characteristics of life in nature. The computers and robots we build are carrying out instructions in a very mechanical way, however impressive they are.
        mehphp 4y ago
        Aren’t our brains just carrying out instructions in a very impressive way? I think the jury is still out on whether or not we actually have any control over our thoughts.
        4y ago
martijnvds 4y ago
Ask any early 80s Sierra adventure game protagonist?
- jasfi 4y ago
  Those early Sierra games, the ones that used typed text to interact with the environment, were really inspirational. I was very disappointed when they replaced that CLI-like interface with mouse-driven icons. No doubt the icons were more user friendly and had none of the flaws of trying to enter the right text, but it still felt like something was lost. Relatedly, I'm working on natural language understanding, which I believe is key to AGI. https://lxagi.com https://lxagi.com
abdulhaq 4y ago
It's not 'like' anything, computer programs don't have true feelings, though they can certainly be programmed to act as if they do. It can be programmed to say 'hey, life is great' but it means nothing. They have no soul, no spark from the divine.
- mckirk 4y ago
  And how do you prove that you have such a spark?
  - abdulhaq 4y ago
    Perhaps I don't have that spark, but deep within and after much thought and contemplation, I believe I have. I am very sure, regardless, that computer programs do not have it.
    - mehphp 4y ago
      We also don’t have AGI yet either… who’s to say that consciousness doesn’t come along for the ride once you reach that level? We don’t even know why we have consciousness.

17 points by korymath 4y ago

bcrl 4y ago

The Bobiverse books by Dennis E. Taylor touch upon this, as Bob is a human that becomes the AI in a replicant that is the intelligence behind a von Neumann probe sent out from earth. One of the ways that he maintains his sanity is to build a simulated VR environment to help maintain his sanity. I personally think that the really hard part in creating an AGI is going to be training. As an adult human, one can look at an object and instantly know what its texture is going to feel like on one's fingers or even lips, how it will bounce and if it will shatter. How did we gain that knowledge? As babies we put absolutely everything we saw into our mouths and sucked or chewed on it. As kids we played for hours on end with all kinds of toys and household objects. Coming up with a way of training an AGI to be human level will be hard, as there is such a vast scope of knowledge in "common sense" that will be exceedingly difficult to implant into an AGI without the AGI having an ability to interact with the real world. On the other hand, once that body of knowledge becomes an available training data set, evolution can take off at speeds otherwise impossible in the real world.

mint2 4y ago

AGI: Adjusted gross income? That didn’t make sense. Acronyms in headline are not the place to put them unless it’s very certain the target audience is innately familiar. Guess I’m not that audience.

porknubbins 4y ago
I agree, and stay in this world too long and all your acronyms will be overloaded. ISA is instruction set architecture ? Income sharing agreement? Especially when the headline poses a counterfactual/impossible question they should help as much as possible.
- na85 4y ago
  >ISA How could you forget "Industry Standard Architecture", the bane of my youth? I once had an old 266 MHz pentium with an ISA network card that was just an absolute nightmare. This was when PCI was dominant and AGP graphics cards had not yet become mainstream, and I guess the ISA drivers just weren't being maintained for Win 98. I had to go into Control Panel and disable/re-enable the Ethernet adapter about three times an hour, because the connection would simply drop and that was the only rectification that I was savvy enough to attempt.
  - porknubbins 4y ago
    Right of course! I forgot it since its been so long, but I’ve certainly read about ISA, thought I think it was obsolete by thr time I was working inside computers.

bmn3267 4y ago

freakin' awesome most probably, if you're on the side of half full glass.

jhbadger 4y ago
It would depend on the legality of the situation -- like in Gibson's Neuromancer where a fully-intelligent AI has Swiss citizenship and yet the software and supercomputer it is running on is owned by a corporation -- “Like, I own your brain and what you know, but your thoughts have Swiss citizenship. Sure. Lotsa luck, AI.” as a character puts it.

jasfi 4y ago

This is projecting way too much of our own experience onto what is really just computer processing.

ravi-delia 4y ago
Everything that computes is probably "just computer processing". I wouldn't be shocked if enough translates that it's not totally useless
- jasfi 4y ago
  Humans have consciousness, which seems like something else related to the physics of our universe. The article hints at AGI having consciousness, but I can't see how that kind of argument can be made.
  - ravi-delia 4y ago
    Ok, assuming consciousness is both reliant on physics we don't understand, and that physics selectively avoids so blessing any machine, you're correct. Is there evidence to support either of those things? Absolutely not.
    - jasfi 4y ago
      Why is consciousness in humans limited to our brains? We've never seen non-living material exhibit the characteristics of life in nature. The computers and robots we build are carrying out instructions in a very mechanical way, however impressive they are.
      - mehphp 4y ago
        Aren’t our brains just carrying out instructions in a very impressive way? I think the jury is still out on whether or not we actually have any control over our thoughts.
        4y ago

martijnvds 4y ago

Ask any early 80s Sierra adventure game protagonist?

jasfi 4y ago
Those early Sierra games, the ones that used typed text to interact with the environment, were really inspirational. I was very disappointed when they replaced that CLI-like interface with mouse-driven icons. No doubt the icons were more user friendly and had none of the flaws of trying to enter the right text, but it still felt like something was lost. Relatedly, I'm working on natural language understanding, which I believe is key to AGI. https://lxagi.com https://lxagi.com

abdulhaq 4y ago

It's not 'like' anything, computer programs don't have true feelings, though they can certainly be programmed to act as if they do. It can be programmed to say 'hey, life is great' but it means nothing. They have no soul, no spark from the divine.

mckirk 4y ago
And how do you prove that you have such a spark?
- abdulhaq 4y ago
  Perhaps I don't have that spark, but deep within and after much thought and contemplation, I believe I have. I am very sure, regardless, that computer programs do not have it.
  - mehphp 4y ago
    We also don’t have AGI yet either… who’s to say that consciousness doesn’t come along for the ride once you reach that level? We don’t even know why we have consciousness.