3 ms·
> Is there any sure way to stop the super intelligent AI from changing its own inherent values though? Yes: give it inherent values. >I guess a problem with c
by eli_gottlieb 12y ago
> Is there any sure way to stop the super intelligent AI from changing its own inherent values though?
Yes: give it inherent values.
>I guess a problem with containment is that unless it's mathematically proven to be impervious,
AGI, when it eventually exists, must run according to the basic laws of learning. If you don't give it evidence that's more likely in possible-worlds with an external world than without one, it won't posit an external world.
Stopping that information leak isn't that hard, provided you have full control over the agent-environment surface in the first place. It does, however, make your "agent" completely useless for anything beyond playing Atari games.