5 ms·
It's not open source. The provide the model and the weights, but not the source code and, crucially, the training data. As long as LLM makers don't provide the
by shafyy 2y ago
It's not open source. The provide the model and the weights, but not the source code and, crucially, the training data. As long as LLM makers don't provide the training data (and they never will, because then they will be admitting to stealing), LLMs are never going to be open source.
- sho_hn 2y agoThanks for reminding people of this. Open source means two things in spirit: (a) You have everything you need to be able to re-create something, and at any step of the process change it. (b) You have broad permissions how to put the result to use. The "open source" models from both Meta so far fail either both or one of these checks (Meta's fails both). We should resist the dilution of the term open source to the point where it means nothing useful.
- jprete 2y agoI think people are looking for the term "freeware" although the connotations don't match.
- sho_hn 2y agoAgreed, but the "connotations don't match" is mostly because the folks who chose to call it open source wanted the marketing benefits of doing so. Otherwise it'd match pretty well.
- HDThoreaun 2y agoOpen source means the source code is freely available. It’s in the name.
- idle_zealot 2y agoThe source being available means the code is "source available." Open implies more rights.
- deleted 2y ago[deleted]
- KPGv2 2y agoAt the risk of being called rms, no, that's not what open source means. Open source just means you have access to the source code. Which you do. Code that is open source but restrictively licensed is still open source. That's why terms like "libre" were born to describe certain kinds of software. And that's what you're describing. This is a debate that started, like, twenty years ago or something when we started getting big code projects that were open source but encumbered by patents so that they couldn't be redistributed, but could still be read and modified for internal use.
- sho_hn 2y ago> Open source just means you have access to the source code. Which you do. No, they also fail even that test. Neither Meta nor DeepSeek have released the source code of their training pipeline or anything like that. There's very little literal "source code" in any of these releases at all. What you can get from them is the model weights, which for the purpose of this discussion, is very similar to compiler binary executable output you cannot easily reverse, which is what open source seeks to address. In the case of Meta, this comes with additional usage limitations on how you may put them to use. As a sibling comment said, this is basically "freeware" (with asterisks) but has nothing to do with open source, either according to RMS or OSI. > This is a debate that started, like, twenty years ago For the record, I do appreciate the distinction. This isn't meant as an argument from authority at all, but I've been an active open source (and free software) developer for close to those 20 years, am on the board of one of the larger FOSS orgs, and most households have a few copies of FOSS code I've written running. It's also why I care! :-)
- JumpCrisscross 2y ago> they also fail even that test. Neither Meta nor DeepSeek have released the source code of the This debate is over and makes the open source community look silly. Open model and weights is, practically speaking, open source for LLMs. I have tremendous respect for FOSS and those who build and maintain it. But arguing for open training data means only toy models can practically exist. As a result, the practical definition will prevail. And if the only people putting forward a practical definition are Meta et al, this is what you get: source available.
- beAbU 2y agoThanks, I was not aware of this distinction. But I think my argument still stands though? Users can run Deepseek locally, so unless the US Gov't wants to reach for book burning levels or idiocy, there is not really a feasible way to ban the American public of running DeepSeek, no?
- coliveira 2y agoPeople say this, but when it comes to AI models, the training data is not owned by these companies/groups, so it cannot be "open sourced" in any sense. And the training code is basically accessing that training data that cannot be open sourced, therefore it also cannot be shared. So the full open source model you wish to have can only provide subpar results.
- sheepdestroyer 2y agoThey could easily list the data used though. These datasets are mostly known and floating around. When they are constructed, instructions for replication could be provided too
- Timon3 2y agoIsn't this the same situation that any codebase faces when one thinks about open sourcing it? I can't legally open source the code I don't own.