Fair enough, but it could be... both ! Since you know that training for photo-realistic faces is going to take extra effort, and that you're not going to allow

Fair enough, but it could be... both ! Since you know that training for photo-realistic faces is going to take extra effort, and that you're not going to allow them - you could just spare that effort ! (Or maybe leave it for later, if the network is flexible enough ?)