Yeah, currently many models do seem to have copied a few pieces of their source material. I was translating code with one of the code- models at OpenAI and it

Yeah, currently many models do seem to have copied a few pieces of their source material. I was translating code with one of the code- models at OpenAI and it spit out about thirty words of someone's code of conduct from Github, almost verbatim. I found the repo by searching what it had produced. That's when I changed my prompts to remove comments, but it stuck with me. In general though, I think the pigeon-hole principle is relevant. The model is fairly small compared to the training material and couldn't contain much actual full content or it wouldn't be able to contain anything about the rest. I've heard people talking about using the model to judge similarity of new training data to what it's already seen, mainly to train more efficiently, but also to avoid this.