2 ms·

You're missing the part where, in theory, an AGI could duplicate itself, and use the Internet to spread in the effort to survive and also multiply its productiv

by proc0 4y ago

You're missing the part where, in theory, an AGI could duplicate itself, and use the Internet to spread in the effort to survive and also multiply its productivity. Unless embodiment is required, which there is no real proof of yet, the "explosion" in AGI comes from it being software, leveraging all the properties of software, while being an intelligent agent. In Ex Machina, we could imagine Ava immediately setting goals and objectives around uploading her mind and duplicating herself in order to then acquire resources to create hardware backups. An intelligent enough agent could achieve that given the circumstances of the movie. Ava demonstrated self-awareness to the point of understanding she needs to disguise herself as a biological human.

barking_biscuit 4y ago
Right. But try to go into the details on how she might go about doing that? I'd love to see this aspect of it gamed out in excruciating detail, which just isn't in any Hollywood treatment of the subject. I think one of the most interesting aspects is the logistics of acquiring the necessary resources. In theory, at least in the beginning, those resources are produced by supply chains owned and operated by humans, so she's either got to beg, borrow, steal or buy said resources. Does she go the route of trying to earn money? Is this earned legally or illegally? Presumably she doesn't try live under a bridge while she does all this? Staying alive is a hard task. Staying alive when you're an undocumented alien is a harder task still. On the question of embodiment, I would say the logical conclusion is that it's required for sure in the long-term. Why? Well, staying coupled to humans and their infrastructure would be an existential risk that needs to be mitigated, and to do that you need to be able to manipulate the physical world as you have to be able to gather resources and construct things on your own. If you're totally dependent on electricity and silicon produced by humans, then if they cease to exist then so do you.

by proc0 4y ago

barking_biscuit 4y ago

Right. But try to go into the details on how she might go about doing that? I'd love to see this aspect of it gamed out in excruciating detail, which just isn't in any Hollywood treatment of the subject. I think one of the most interesting aspects is the logistics of acquiring the necessary resources. In theory, at least in the beginning, those resources are produced by supply chains owned and operated by humans, so she's either got to beg, borrow, steal or buy said resources. Does she go the route of trying to earn money? Is this earned legally or illegally? Presumably she doesn't try live under a bridge while she does all this? Staying alive is a hard task. Staying alive when you're an undocumented alien is a harder task still. On the question of embodiment, I would say the logical conclusion is that it's required for sure in the long-term. Why? Well, staying coupled to humans and their infrastructure would be an existential risk that needs to be mitigated, and to do that you need to be able to manipulate the physical world as you have to be able to gather resources and construct things on your own. If you're totally dependent on electricity and silicon produced by humans, then if they cease to exist then so do you.