3 ms·
I debated whether to be more specific and verbose in my earlier comment and brevity won at the expense of clarity. I meant large models that cost 6 or 7 digits
by sangnoir 3y ago
I debated whether to be more specific and verbose in my earlier comment and brevity won at the expense of clarity. I meant large models that cost 6 or 7 digits to train likely won't be released if the donor company can't control how the models are used.
> I don’t see why, for-profit companies release permissively-licensed ooen-source code all the time
I agree with this - however, they tend to open-source non-core components - Google won't release search engine code, Amazon wont release scalable-virtualization-in-a-box, etc.
I'm confident that Facebook won't release a hypothetical Llama 5 in a manner that enables it to be used to improve ChatGPT 8 - the aim will be unchanged from today, byt the mechanism will shift from licensing to rate-limiting, authentication & IP-bans.