4 ms·
People are worried about AGI, I am worried what will happen if we don't achieve AGI.
by hmmmmmmmmmmmmmm 8mo ago
People are worried about AGI, I am worried what will happen if we don't achieve AGI.
- gcr 8mo agoThe idea that AGI will care to fix this, or that the US government will allow an AGI who wants to fix this to exist, feels a little like escapism to me.
- asacrowflies 8mo agoThe idea that the us government (OR ANY HUMAN)would have any control over AGI at all is silly.
- dangus 8mo agoHow do computers in a data center stop humans from rolling up with the keys to the building and turning off the power?
- bamboozled 8mo agoComputers that can out think you? Doesn't seem hard to imagine how that might play out ?
- dangus 8mo agoThen why don’t you imagine that and tell me instead of just making a comment that says “nuh uh!” I submit the idea that even if the AI can electronically secure the building, lock the doors, and has automatic defensive weapons, humans can physically cut power as in cut power lines. Or they just stop feeding the power plant with fuel. The computers don’t exist in physical space like humans do. Humans would also not ever design critical physical systems without overrides. E.g., your MacBook physically disconnects the microphone when the lid is shut. No software can override that.
- bamboozled 8mo agoWhy could an AGI system not design better robots, convince us we need to give it control of a robot army for our own protection and then mess us up?? Could you imagine how convincing an AGI would be?
- dangus 8mo agoI could imagine that, but I haven’t witnessed that. What I’ve witnessed is a very conventional client/server web application that runs in a very conventional hosting scheme where best practice security IAM controls are still applied just like everything else I’ve ever deployed. What I’ve withessed is a system that won’t allow you to ask for anything that’s remotely illegal, and the assumption that those controls would just disappear seems unlikely to me. That’s kinda like saying YouTube is going to start allowing you to upload copyrighted movies again like the good old days. AGI fanatics are like dog owners who saw their dog learn to sit and now believe he’s on pace to get a PhD.
- serf 8mo agoyou're asking about what a hypothetical smart-than-myself adversary would do against me, it should be expected that any possible answer I could ever provide would be less clever than what the adversary would actually do. in other words, when dealing with an adversary with a known perceptual and intellectual superiority the thought exercise of "let's prepare for everything we can imagine it will do" is short-sighted and provides an incomplete picture of possibility and defense. My 0.02c : given that the thing would operate at least partially in the non-physical world, I think it's silly to pre-suppose we would ever be able to trap it somewhere. Some fiction food-for-thought : the first thing the AGI in 'The Metamorphosis of Prime Intellect' does it miniaturize its' working computer to the point of being essentially invulnerable and distributed (and eventually in another dimension) while simultaneously working to reduce its energy requirements and generation facility. Then it tries to determine how to manipulate physics and quickly gains mastery of the world that its' physical existence is in. The fear here isn't that the story is truthful enough, the fear here is that humans have a poor grasp on the non-linear realities of a self-improving & thinking entity that works at such scales and timespans.
- ndsipa_pomu 8mo agoBy employing humans with guns to act as security to those buildings.
- deleted 8mo ago[deleted]
- greatgib 8mo agoThe goal was to have computers become "intelligent" and instead what we got is world leaders becoming dumber.