3 ms·
If you think that, with our current limited knowledge and relatively limited resources, we can anticipate what is necessary to constrain AI to be "friendly" or
by giardini 17y ago
If you think that, with our current limited knowledge and relatively limited resources, we can anticipate what is necessary to constrain AI to be "friendly" or that we can somehow protect ourselves from something that can reproduce the entire logical thought process of mankind in minutes then you have a very romantic view of human accomplishment. Indeed, that would make you the "John Henry" of AI.
- Eliezer 17y agoOn this I can only refer you to e.g. http://singinst.org/AIRisk.pdf http://singinst.org/AIRisk.pdf. This is a standard reaction, and the standard reply is "The goal is to build something that doesn't want to hurt you in the first place." No one's trying to "constrain" anything, except in the sense that a programmer "constrains" code, not by fighting it, but by writing that particular piece of code into existence out of an exponentially vast space of possible alternatives.