GANs can be trained without gradients using reinforcement learning. Even without GANs, just being able to tune hyper-parameters with such a discriminator should

GANs can be trained without gradients using reinforcement learning. Even without GANs, just being able to tune hyper-parameters with such a discriminator should be a strong signal for the synthesizer.