3 ms·
Sadly there just isn’t enough public domain data. It would mean that it’ll be impossible to catch up to ChatGPT. One way to see this is to imagine a Midjourney
by sillysaurusx 3y ago
Sadly there just isn’t enough public domain data. It would mean that it’ll be impossible to catch up to ChatGPT.
One way to see this is to imagine a Midjourney competitor trained solely on public domain images. The visual quality of the model will always be worse.
As for licensing, I agree for commercial entities, but there should be exceptions. If a model is open source, it benefits everyone, and so it shouldn’t need to have been licensed. There are a few reasons why this is pretty important, but the main one is that without it, the open source community has no chance whatsoever of creating cutting edge models.
- dcow 3y agoI think you can reasonably imagine that if content is available in a library then everyone could organize an effort to check out the content and add it to the model. That effort sounds like useless theatre at that point so just let the commons keep an `all-booksN.zip` corpus around for the purpose. You know, you could probably even argue traditionally that taking all the books in the world and adding them to a corpus for the purpose of creating an LLM would be a transformative work since it doesn't compete with or detract from any of the originals…