3 ms·
> I'm even inclined to wonder if the question of "will the humans try to deactivate me for doing this?" might be a close enough analog for "is this in line with
by Filligree 9y ago
> I'm even inclined to wonder if the question of "will the humans try to deactivate me for doing this?" might be a close enough analog for "is this in line with human morals?".
The problem with that statement, of course, is that the very next question it asks will be "Or can I stop them?"
That may take the form of convincing arguments, brute force or something we've never thought of yet, but the only way to avoid it is to prevent the AI from wanting to do anything we don't want it to.
Which is a much harder problem.
- sgt101 9y agoOr do I care? Were assume that AI worries about its future, it might not give a toss!
- Filligree 9y agoYou're right; I misspoke. Making the AI indifferent to its own survival is indeed another way of improving safety. That's still very difficult, though. Have you read the Basic AI Drives paper?