4 ms·

Given it's ridiculous license, how can we? I'd rather accept meta's proprietary "open source" license that deal with that nonsense.

by Zuiii 3y ago

kyboren 3y ago
I don't really understand all the fuss about license agreements in this space. Just ignore their stupid license and obtain the model weights via alternative means. Both LLaMA and LLaMA v2 are readily available on BitTorrent[0]. It's not clear to me whether compilations of model weights are really copyrightable in most jurisdictions. Even if they were, enforceability is highly questionable. Anyway downloading is not the same as uploading; the recipient is not the one making the copy. So long as you are not redistributing the model weights but just using those model weights to do something, I don't see how you're violating copyright. If you pirate a compiler and distribute your own software compiled with it--is that compiled software a derivative work of the compiler? Is my proprietary software a derivative work of g++ because I used it to compile my software? Even providing a direct API to inference with or finetuning a model should be OK. I can't see how the output of inference could be a derivative work of the model, which is only part of the input along with the hyperparameters, seed value, potential fine-tuning data, and the prompt. If, alternatively, it was, then the output of training (i.e. the model itself) is surely a derivative work of the input--including my data they slurped up! On the other hand, redistributing finetuned models might need to be done by weight diffs, as those probably are derived works. [0]: e.g. b8287ebfa04f879b048d4d4404108cf3e8014352 and 14ec42c98d0b12f5b12f5b3d670cdf4915c1feaf
- orra 3y ago
  Your proprietary software won't be a derivative work of most of G++, but it will likely be a derivative work of libgcc (compiler runtime), libc (on Linux), and libstdc++. Anyway, running copyrighted software without a valid license is clear cut unlawful, at least in the EU. That's because running the application requires copying it (into RAM). No, really, the law is that pedantic. "Loading" is a restricted act under Article 4 of the Computer Programs Directive.
haolez 3y ago
Eventually, other (real) open source models will reach this size as well. I was just wondering about the technical aspects of a model this big. Does performance escalate? Does it saturate quickly around 70B? Something like that.

Given it's ridiculous license, how can we? I'd rather accept meta's proprietary "open source" license that deal with that nonsense.

by Zuiii 3y ago

Given it's ridiculous license, how can we? I'd rather accept meta's proprietary "open source" license that deal with that nonsense.

kyboren 3y ago

I don't really understand all the fuss about license agreements in this space. Just ignore their stupid license and obtain the model weights via alternative means. Both LLaMA and LLaMA v2 are readily available on BitTorrent[0]. It's not clear to me whether compilations of model weights are really copyrightable in most jurisdictions. Even if they were, enforceability is highly questionable. Anyway downloading is not the same as uploading; the recipient is not the one making the copy. So long as you are not redistributing the model weights but just using those model weights to do something, I don't see how you're violating copyright. If you pirate a compiler and distribute your own software compiled with it--is that compiled software a derivative work of the compiler? Is my proprietary software a derivative work of g++ because I used it to compile my software? Even providing a direct API to inference with or finetuning a model should be OK. I can't see how the output of inference could be a derivative work of the model, which is only part of the input along with the hyperparameters, seed value, potential fine-tuning data, and the prompt. If, alternatively, it was, then the output of training (i.e. the model itself) is surely a derivative work of the input--including my data they slurped up! On the other hand, redistributing finetuned models might need to be done by weight diffs, as those probably are derived works. [0]: e.g. b8287ebfa04f879b048d4d4404108cf3e8014352 and 14ec42c98d0b12f5b12f5b3d670cdf4915c1feaf

orra 3y ago
Your proprietary software won't be a derivative work of most of G++, but it will likely be a derivative work of libgcc (compiler runtime), libc (on Linux), and libstdc++. Anyway, running copyrighted software without a valid license is clear cut unlawful, at least in the EU. That's because running the application requires copying it (into RAM). No, really, the law is that pedantic. "Loading" is a restricted act under Article 4 of the Computer Programs Directive.

haolez 3y ago

Eventually, other (real) open source models will reach this size as well. I was just wondering about the technical aspects of a model this big. Does performance escalate? Does it saturate quickly around 70B? Something like that.