Sounds like a combination of a GAN[1] and RLHF. Not surprising that this works. [1] - https://en.wikipedia.org/wiki/Generative_adversarial_network https://en.w

Sounds like a combination of a GAN[1] and RLHF. Not surprising that this works. [1] - https://en.wikipedia.org/wiki/Generative_adversarial_network https://en.wikipedia.org/wiki/Generative_adversarial_network