An AI that thinks like its user seems an awful idea to me. It's exactly the sycophancy issue that everyone has been complaining about- a user that suffers of de

An AI that thinks like its user seems an awful idea to me. It's exactly the sycophancy issue that everyone has been complaining about- a user that suffers of delusions or any sort of crackpot ideas can get them reinforced by such an AI. It would be the opposite of helpful. One of the most valuable aspects of an AI partner is its otherness, the ability to provide some external or objective point of view. If it's just repeating yours, it's useless. AIs are already, to a certain extent, ego-less: they are quick to adopt the point of view of their user. And when their intelligence is- except in case of overt censorship and political biases- always used to advance the interest of their user. Finally the idea that a user-aligned AI would make its human user irreplaceable by companies seems a total non-sequitur, or I didn't get the argument at all (in which case maybe someone can explain it).