Kind of a nitpick, but AIs mostly don't get to choose what's "right". I mean they're trained with a particular goal in mind already, so either their training da

Kind of a nitpick, but AIs mostly don't get to choose what's "right". I mean they're trained with a particular goal in mind already, so either their training data or whatever metric their self-training is set to optimize defines "right" for them in advance. It's not AIs that are struggling to find a better version of "right", it's people building AIs.