Yes, see causalmodel's comment. I missed that the researchers trained the AI on The Pile but did some post-conditioning on MOSS, which contains GPT-3.5 output.

Yes, see causalmodel's comment. I missed that the researchers trained the AI on The Pile but did some post-conditioning on MOSS, which contains GPT-3.5 output. To be clear: it's fine for commercial / personal / etc LLMs to train on GPT. But it's not so fine when research LLMs do it: those benchmarks don't mean very much if you're training the AI on GPT's answers to the benchmarks. Test contamination is bad enough in LLM research; using datasets like MOSS in academic papers is just reckless.