4 ms·

Doesn’t matter. The weights wouldn’t exist without many tens of millions (at least) in investment. The outcome seems very clear.

papercrane 4y ago
US copyright law cares about originality and expressiveness, not labour and cost. It can be very expensive to collect and print a list of every business and their phone number in a book, but the result is not copyrightable in the US.
- evandale 4y ago
  This is a pretty compelling argument to me that the weights shouldn't be able to be copyrighted. In essence, aren't they a list of numbers you can search through to get a result? Would it makes sense to say a "give me a rowboat on the water" prompt (search) is the same as a "give me the phone number of company XYZ" search in a phonebook? What exactly is a prompt anyway? Can you copyright the assembly that a compiler spits out? Is an AI prompt the same as source code and its output is the assembly a compiler would generate? Does that mean the model is a compiler? I assume a compiler can be copyrighted, so then maybe the weights can be copyrighted? Or would it make more sense that the combination of (weights + prompt + seed + output) is copyrightable? I don't have answers to any of these or know if they're reasonable questions but I'm starting to find this all very fascinating.
postalrat 4y ago
If you are mining Bitcoin can you copyright a block you discover? You probably payed a lot of money for it.
pygy_ 4y ago
IANAL, but I don't think the DMCA applies. Copyright applies to creative work, and model weights aren't that. It is however my understanding that downloading them can be considered a misappropriation of a trade secret. Folks that would contest the bogus DMCA takedown requests would be liable to a trade secret suit.
- rvnx 4y ago
  archive.org may be the legal solution ?
- UncleEntity 4y ago
  You can’t just assert “this is a secret” and force people you have no contractual relationship with to comply with your assertion. IMHO, not a lawyer. The person who leaked the weights on BitTorrent is definitely liable for violating whatever restrictions they agreed to to get access to them though.
blackbear_ 4y ago
Don't forget that transformers, the basic architecture of these large language models, were introduced by Google, and many other basic building blocks were introduced by universities and research centers all over the world. So no, the outcome is not very clear, at all.
- nl 4y ago
  This is irrelevant.

papercrane 4y ago

US copyright law cares about originality and expressiveness, not labour and cost. It can be very expensive to collect and print a list of every business and their phone number in a book, but the result is not copyrightable in the US.

evandale 4y ago
This is a pretty compelling argument to me that the weights shouldn't be able to be copyrighted. In essence, aren't they a list of numbers you can search through to get a result? Would it makes sense to say a "give me a rowboat on the water" prompt (search) is the same as a "give me the phone number of company XYZ" search in a phonebook? What exactly is a prompt anyway? Can you copyright the assembly that a compiler spits out? Is an AI prompt the same as source code and its output is the assembly a compiler would generate? Does that mean the model is a compiler? I assume a compiler can be copyrighted, so then maybe the weights can be copyrighted? Or would it make more sense that the combination of (weights + prompt + seed + output) is copyrightable? I don't have answers to any of these or know if they're reasonable questions but I'm starting to find this all very fascinating.

postalrat 4y ago

If you are mining Bitcoin can you copyright a block you discover? You probably payed a lot of money for it.

pygy_ 4y ago

IANAL, but I don't think the DMCA applies. Copyright applies to creative work, and model weights aren't that. It is however my understanding that downloading them can be considered a misappropriation of a trade secret. Folks that would contest the bogus DMCA takedown requests would be liable to a trade secret suit.

rvnx 4y ago
archive.org may be the legal solution ?
UncleEntity 4y ago
You can’t just assert “this is a secret” and force people you have no contractual relationship with to comply with your assertion. IMHO, not a lawyer. The person who leaked the weights on BitTorrent is definitely liable for violating whatever restrictions they agreed to to get access to them though.

blackbear_ 4y ago

Don't forget that transformers, the basic architecture of these large language models, were introduced by Google, and many other basic building blocks were introduced by universities and research centers all over the world. So no, the outcome is not very clear, at all.

nl 4y ago
This is irrelevant.