3 ms·

Yes and that's a big part of the problem. It does not have a concept of "after" the victory. So if it gains autonomy there is high chance of it destroying ever

Yes and that's a big part of the problem. It does not have a concept of "after" the victory. So if it gains autonomy there is high chance of it destroying everything else before dying itself. I found the story of Horizon Zero dawn highly plausible. The main takeaway - dumb military AIs destroy all the living things. The only bit we are missing is fully automated fabrication.

skissane 6y ago
> The only bit we are missing is fully automated fabrication. Supply chains for high tech goods such as AI-powered autonomous fighter jets are extremely complex. We've already automated some of the individual steps, and will surely in the coming decades automate many more. But high-level orchestration of the chains as a whole, that requires many human-level intelligences to cooperate in advanced social systems, I don't think anything short of general AI could replace that.
dogma1138 6y ago
HZD is a grey goo scenario with extra steps. Not only what we are missing is self replication but everything else including the important part and what was the problem “converting bio-mass into energy” without that it wouldn’t be an issue, not to mention that HZD makes little sense in general even with the coverup nukes exist and they blow up shit just fine their lore made little sense in the long run as they couldn’t replicate they just had really big robots the octopus ones that could manufacture more of the smaller ones. And more importantly since the biomass conversion was basically nano machines why couldn’t you produce a swarm of them that simply eats robots? Or why couldn’t you produce a swarm of robots to fight the rogue swarm. The whole “unhackable” thing also doesn’t makes sense and if they were then well make another swarm that just is unhackable and let them duke it out. The technology and more importantly the consistency of the technology in that universe makes absolutely no sense. As much as I liked the game the story while cool was about as plausible as an alien invasion that triggers a zombie apocalypse followed by the second coming.

skissane 6y ago

> The only bit we are missing is fully automated fabrication. Supply chains for high tech goods such as AI-powered autonomous fighter jets are extremely complex. We've already automated some of the individual steps, and will surely in the coming decades automate many more. But high-level orchestration of the chains as a whole, that requires many human-level intelligences to cooperate in advanced social systems, I don't think anything short of general AI could replace that.

dogma1138 6y ago

HZD is a grey goo scenario with extra steps. Not only what we are missing is self replication but everything else including the important part and what was the problem “converting bio-mass into energy” without that it wouldn’t be an issue, not to mention that HZD makes little sense in general even with the coverup nukes exist and they blow up shit just fine their lore made little sense in the long run as they couldn’t replicate they just had really big robots the octopus ones that could manufacture more of the smaller ones. And more importantly since the biomass conversion was basically nano machines why couldn’t you produce a swarm of them that simply eats robots? Or why couldn’t you produce a swarm of robots to fight the rogue swarm. The whole “unhackable” thing also doesn’t makes sense and if they were then well make another swarm that just is unhackable and let them duke it out. The technology and more importantly the consistency of the technology in that universe makes absolutely no sense. As much as I liked the game the story while cool was about as plausible as an alien invasion that triggers a zombie apocalypse followed by the second coming.