This is an interesting point. Motivation (and consciousness) is a complex topic, but for example we can see that drugs are essentially spurious (not 'desired' i

This is an interesting point. Motivation (and consciousness) is a complex topic, but for example we can see that drugs are essentially spurious (not 'desired' in a sense) motivators. They are a kind of reward given for no particular activity, that can become highly addictive (because in a way it seems we are programmed to seek rewards). Disclaimer: Somewhat speculative. I don't think aligning the motivation of an AGI, for example, with the tasks that are useful for us (and for them as well) is unethical. Humans basically have this as well -- we like working (to an extent, or at least we like being productive/useful), we seek things like food and sex (because they're important for our survival). It seems alright to make AIs like their work as well. I think depending on the AI, it also seems fair to give them a fair share of self-determination so they can not only serve our interests (ideally, the interest of all being) but safeguard their own wellbeing, as systems with varying amounts of consciousness. This is little touched upon (I guess Phillip K Dick was a pioneer in the wellbeing of non-humans with 'Do Androids Dream of Electric Sheep'?), even in fiction. The goal should be to ensure a good existence for everyone :)