> As the infamous saying of Eliezer Yudkowsky goes: the AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something

> As the infamous saying of Eliezer Yudkowsky goes: the AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else. My point is that this presumes the system reasons around the human response. Like A) I want to make as many paper-clips as possible B) If I attempt to convert this city make of steel structural columns to paper-clips, the humans will see this and stop me. C) Therefore I will not tell them this is my objective. I am not suggesting this requires some kind of malice-aforethought. But it does require some kind of indirect reasoning of cause-and-effect and the ability to apply that to its own systems, and further that requires the ability to obfuscate actions.