> We should be less concerned about the consciousness of the AI Author's warning seems to be: 1. "Conscious" means you can feel things (have feelings) 2. "Co

> We should be less concerned about the consciousness of the AI Author's warning seems to be: 1. "Conscious" means you can feel things (have feelings) 2. "Conscious" means you can have intentions 3. --> A conscious AI could be hurt, take umbrage, and take measures to either protect itself or take revenge. Kids tear wings off insects; I can certainly imagine people inflicting pain on a machine on the principle that it's "just" a machine. Like, you're angry, you want to hurt someone (or kick the cat), but you refrain, because you're a decent person and don't do that kind of thing. Hurting a conscious, intelligent machine could have bad consequences. I don't happen to believe that consciousness is some kind of extended intelligence, so I don't believe that AI research is ever going to result in machine consciousness. I certainly don't know what consciousness is; but provisionally, I take the view that it's fundamental - that everything else depends on consciousness, not the other way round.