I agree that high-quality datasets, usually proprietary, are key to good model performance. Microsoft's Phi-2 model for example is punching way above its weight

I agree that high-quality datasets, usually proprietary, are key to good model performance. Microsoft's Phi-2 model for example is punching way above its weight thanks to being fed high-quality textbooks and encyclopedias. But that's not a total showstopper. To use those, deals can be arranged since many textbooks come from just a few publishing houses. Heavyweights like Microsoft can do that. And a comparatively small model might actually be less likely to reproduce content versatim even if prompted. I am more curious whether researchers and private persons will be permitted to continue uploading models on Huggingface.