3 ms·
Precisely. This is attempting to implement morality by constraining. Hence, it’s not morality.
by stonethrowaway 2y ago
Precisely. This is attempting to implement morality by constraining. Hence, it’s not morality.
- mitthrowaway2 2y agowaveBidder was explaining the orthogonality thesis: it can have unbeatable intelligence that will out-wit and out-strategize any human, and yet it can still have absolutely abhorrent goals and values, and no regard for human suffering. You can also have charitable, praiseworthy goals and values, but lack the intelligence to make plans that progress them. These are orthogonal axes. Great intelligence will help you figure out if any of your instrumental goals are in conflict with each other, but won't give you any means of deriving an ultimate purpose from pure reason alone: morality is a free variable, and you get whatever was put in at compile-time. "Super" intelligence typically refers to being better than humans in achieving goals, not to being better than humans in knowing good from evil.