5 ms·
Even if the weights are copyrighted, running one more epoch of fine-tuning will result in different weights. At a certain point, they'd have to copyright the sh
by mattmcknight 4y ago
Even if the weights are copyrighted, running one more epoch of fine-tuning will result in different weights. At a certain point, they'd have to copyright the shapes of the weight vectors.
- Szpadel 4y agois uncertain, as with codding you need white room methods to prove that new code is not contaminated with patented implementation, as it might be here, so basing anything on an existing model could be also copyrighted.
- 0x0000000 4y agoClean room implementation is not a defense against patents, it is a defense against copyright infringement.
- MacsHeadroom 4y agoThe model isn't code to a new model trained on it, it's training data; just like the pirated torrent site Books3 dataset Facebook used to train LLaMA. The training code is Apache 2.0 licensed so it can be copied and modified freely, including for commercial purpoes. https://github.com/facebookresearch/llama https://github.com/facebookresearch/llama
- Szpadel 4y agoIf you see generating model weights in the same way like generating executable binary from source code, then sure. But AFAIK this is just the first step to get initial weights and later you need much more work to fine-tune this to get useful results from the model. I think this step could be seen as contaminating weights with copyrighted content. Something like chrome is copyrighted but chromium is not I'm not a lawyer, so I'm not that well informed how official definitions match here, but what's I'm trying to say it that I wouldn't be surprised if this would go either way
- pmoriarty 4y agoWith so much money and so many competing interests involved, it'll take decades for this to wind its way through the courts, and by then there's a good chance we'll have strong AI and all such concerns will be moot.