It is a remarkable achievement. But if “some training data from OpenAI” turns out to essentially be a wholesale distillation of their entire model (along with

It is a remarkable achievement. But if “some training data from OpenAI” turns out to essentially be a wholesale distillation of their entire model (along with Llama etc) I do think that somewhat dampens the spirit of it. We don’t know that of course. OpenAI claim to have some evidence and I guess we’ll just have to wait and see how this plays out. There’s also a substantial difference between training of the entire internet and one that very specifically targets your competitor's products (or any specific work directly).