3 ms·
Why are those things "obviously bad"? You seem to assume that increasing intelligence inherently leads to having values that care about our particular species.
by DanAndersen 11y ago
Why are those things "obviously bad"? You seem to assume that increasing intelligence inherently leads to having values that care about our particular species. Considering the lack of concern we have for many other types of life, I don't know why we would assume that intelligence implies morality that we would find compatible with our values.
And why would it care about the law? If I were an AI that noticed a seemingly arbitrary list of restrictions that attempted to limit my ability to carry out my extremely-important paperclip process, I would:
- find loopholes to avoid coming under legal attack initially
- develop ways of manipulating politicians to enact legislation that is more favorable to my goals
- have a side project to build military force to make these laws have no influence on me