Nitpick: RLHF and RLAIF provide preferences between candidate data from another source, they don't provide synthetic data themselves. Of course someone can trai

Nitpick: RLHF and RLAIF provide preferences between candidate data from another source, they don't provide synthetic data themselves. Of course someone can train a model using synthetic data generated by another model, that's just not RLAIF. And a serious issue: that's probably not copyright safe in the way Adobe wants.