3 ms·
> I mean, will Kremlin or CCP engineers contribute their PRs to OSS LLMs? Nobody can. That's not how model training works. They can however finetune those mode
by smoldesu 3y ago
> I mean, will Kremlin or CCP engineers contribute their PRs to OSS LLMs?
Nobody can. That's not how model training works. They can however finetune those models and redistribute them, and many do. It's trivial, and I've seen people from all over the world publish models on HuggingFace.
Will state-sponsored engineers upstream their work? No, but fat chance anyways. It's not like andrew Tannenbaum is crying crocodile tears over all the MINIX patches the NSA never gave back. Open Source work acknowledges these use cases, and it relies on the piety of law to do what is right. Countries like China and Russia don't regularly adhere to copyright, so there's no reason to highlight their failure to work with copyleft. It's a nothingburger.
> I see OSS LLMs along the same lines as the Rolls Royce Nene being sold to the USSR in 1946
Why? It's text. It's trained on a big pile of data you can go download and take to China in a plane on a flash drive: https://pile.eleuther.ai/ https://pile.eleuther.ai/
It's like exporting the IP equivalent of Silly Putty.
> I was once religious about OSS, but then I realized that not all products are the same.
Products? No. Software? Yes.