5 ms·
> The copyright battles affect models that were trained with datasets where the copyright holder's approval is missing. Which is likely to be most/all of the h
by bluescrn 3y ago
> The copyright battles affect models that were trained with datasets where the copyright holder's approval is missing.
Which is likely to be most/all of the high-profile text and image generation stuff. Where do you get a vast and varied enough library of non-copyrighted text and images on a vast range of subjects? (Even if you rely on something like owning a social media platform, how do you filter out copyright-infringing content that users will inevitably post?)
More specialised datasets for specific tasks can be gathered safely, but, with the exception of self-driving vehicles, that's not really where the AI hype bubble is. It's all about ChatGPT, AI art, and the push for for AGI.
- samus 3y agoI agree that high-quality datasets, usually proprietary, are key to good model performance. Microsoft's Phi-2 model for example is punching way above its weight thanks to being fed high-quality textbooks and encyclopedias. But that's not a total showstopper. To use those, deals can be arranged since many textbooks come from just a few publishing houses. Heavyweights like Microsoft can do that. And a comparatively small model might actually be less likely to reproduce content versatim even if prompted. I am more curious whether researchers and private persons will be permitted to continue uploading models on Huggingface.