4 ms·
whats the diff between me giving it the objective "make money" and evolution giving us the objective "make copies"?
by IIAOPSW 4y ago
whats the diff between me giving it the objective "make money" and evolution giving us the objective "make copies"?
- freemint 4y agoBecause we can choose not to, if an AI is designed to maximize an objective it will maximize that objective. The moment we make a human with a singular objective which they pursue above all else he is no longer free either. Optimization for one objective eliminates all degrees of freedom in a system but for different (global?) minima one of which can be picked.
- IIAOPSW 4y agoBut, despite all the degrees of freedom of choice, you cannot ignore the most basic objective function that nature has handed us: stay alive. You can't really choose not to buy food and pay rent. Arguably, at least from an evolutionary perspective, all other choices and wants are in service of this objective (albeit in very indirect and abstract ways).