I wouldn't characterize it as overfitting, since the evaluation function exists to filter some of the output. This is basically biasing the model towards a sub

I wouldn't characterize it as overfitting, since the evaluation function exists to filter some of the output. This is basically biasing the model towards a subset of the latent space that the evaluation function says is "good" in a very roundabout way.