3 ms·
Can you elaborate on the outer-directed vs inner-directed distinction (or link to something else which does, if that would be more convenient)? I'm not quite s
by drdeca 6y ago
Can you elaborate on the outer-directed vs inner-directed distinction (or link to something else which does, if that would be more convenient)?
I'm not quite sure what you mean by "sets its own goals" (for "inner-directed").
I assume you don't mean "modifies its own goals" (as, why would that help further its current goals?), but I'm not sure what it would mean.
Maybe you mean like, if it acquires goals and preferences in the way that humans do, with shifting likes and dislikes that aren't consistent across time? Yes, that would certainly be quite dangerous (unless the AGI was via like, just emulating a human's mind, which might not be so dangerous, in which case only somewhat dangerous).
I believe I see your point in the safety features in having it receive a specific short term task, achieve the task, and then stop. Once it stops, it isn't doing things anymore, and therefore isn't causing more problems. But it seems like it might be difficult to define that precisely? Like, suppose it takes some actions for a period of time, but complicated and anticipated-by-it-but-not-by-us consequences of its actions continue substantially after it has stopped?