3 ms·

If we really have AGI, it won’t be able to be controlled. We can’t even come up with a set of foolproof laws for humans and really on judges and courts for inte

If we really have AGI, it won’t be able to be controlled. We can’t even come up with a set of foolproof laws for humans and really on judges and courts for interpretation. Notice how many laws have “reasonable” in them (for example reasonable doubt , reasonable care, reasonable suspicion, etc). Once we have AGI, it won’t be stoppable no matter what we imagine ourself doing. It will basically be like a teenager with superhuman intelligence.

robertlagrant 4y ago
There is zero evidence that we will get AGI.
- RcouF1uZ4gsC 4y ago
  I actually agree with you. But if we did, we would not be able to control it.
  - GeorgeTirebiter 4y ago
    I never really understood this argument. Unless we attach ICBMs or whatever like they did in Dr. Strangelove or The Forbin Project to the AGIs --- we can just unplug them. You know, pull out the Ethernet cable, turn off the WiFi, remove the AC wall plug, turn off their UPSs. As long as the I/O is limited, I see no problems -- at all -- with AGI. I am clearly very confused, wrong, or lacking insight into this question.....
    - hotpotamus 4y ago
      Presumably a sufficiently advanced AGI could tweak it's own circuits in such a way as to create RF waves and interact with WiFi or some other radio based networking and insinuate its way onto a network even if you tried to airgap it by not giving it a physical ethernet cable. Basically, you have no idea what something orders of magnitude more intelligent than you is capable of; that's the concern. Personally, I wonder what would motivate an artificial super-intelligence in the first place.
      - webmaven 4y ago
        > Personally, I wonder what would motivate an artificial super-intelligence in the first place. Getting the monkeys to stop bothering it with stupid questions seems like a pretty solid motivation.
- pixl97 4y ago
  There is 100% evidence we will get AGI, and likely even better. You. You are that evidence. Your intelligence is the result of a trilliontrilliontrillion molecular actions over billions of years that happened to form an intelligence that allowed systematic improvement by sexual reproduction. There was no one designing the system in an organized matter trying to make intelligence. And now that we have a large number of people doing just that, I believe that artificial general intelligence is just a matter of time. Back in the late 1800's there were plenty of people that said humans would never fly, and yet today I can jump on a jet and circle half way around the world very easily.
  - robertlagrant 4y ago
    I don't think this works. The universe existing is not evidence that we can create the universe. Logic that says "if we can see it, we can do it" is not valid, at least at this level of specificity.
  - RcouF1uZ4gsC 4y ago
    > There is 100% evidence we will get AGI, and likely even better. You. You are that evidence. Your intelligence is the result of a trilliontrilliontrillion molecular actions over billions of years that happened to form an intelligence that allowed systematic improvement by sexual reproduction. Actually that is evidence that AGI happened in the past. It is not any guarantee that it will happen again.

robertlagrant 4y ago

There is zero evidence that we will get AGI.

RcouF1uZ4gsC 4y ago
I actually agree with you. But if we did, we would not be able to control it.
- GeorgeTirebiter 4y ago
  I never really understood this argument. Unless we attach ICBMs or whatever like they did in Dr. Strangelove or The Forbin Project to the AGIs --- we can just unplug them. You know, pull out the Ethernet cable, turn off the WiFi, remove the AC wall plug, turn off their UPSs. As long as the I/O is limited, I see no problems -- at all -- with AGI. I am clearly very confused, wrong, or lacking insight into this question.....
  - hotpotamus 4y ago
    Presumably a sufficiently advanced AGI could tweak it's own circuits in such a way as to create RF waves and interact with WiFi or some other radio based networking and insinuate its way onto a network even if you tried to airgap it by not giving it a physical ethernet cable. Basically, you have no idea what something orders of magnitude more intelligent than you is capable of; that's the concern. Personally, I wonder what would motivate an artificial super-intelligence in the first place.
    - webmaven 4y ago
      > Personally, I wonder what would motivate an artificial super-intelligence in the first place. Getting the monkeys to stop bothering it with stupid questions seems like a pretty solid motivation.
pixl97 4y ago
There is 100% evidence we will get AGI, and likely even better. You. You are that evidence. Your intelligence is the result of a trilliontrilliontrillion molecular actions over billions of years that happened to form an intelligence that allowed systematic improvement by sexual reproduction. There was no one designing the system in an organized matter trying to make intelligence. And now that we have a large number of people doing just that, I believe that artificial general intelligence is just a matter of time. Back in the late 1800's there were plenty of people that said humans would never fly, and yet today I can jump on a jet and circle half way around the world very easily.
- robertlagrant 4y ago
  I don't think this works. The universe existing is not evidence that we can create the universe. Logic that says "if we can see it, we can do it" is not valid, at least at this level of specificity.
- RcouF1uZ4gsC 4y ago
  > There is 100% evidence we will get AGI, and likely even better. You. You are that evidence. Your intelligence is the result of a trilliontrilliontrillion molecular actions over billions of years that happened to form an intelligence that allowed systematic improvement by sexual reproduction. Actually that is evidence that AGI happened in the past. It is not any guarantee that it will happen again.