> are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop You can be assured that they are definit

> are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop You can be assured that they are definitely doing exactly that on all of the data they can get their hands on. It's the only way they can really improve the model after all. If you don't want the model spitting out something you told it to some other person 5 years down the line, don't give it the data. Simple as.