3 ms·
It's. not. open. source! https://www.downloadableisnotopensource.org/ https://www.downloadableisnotopensource.org/
by fragmede 1y ago
It's. not. open. source!
https://www.downloadableisnotopensource.org/ https://www.downloadableisnotopensource.org/
- quarters 1y agoOk https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/blob/main/LICENSE https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/blob/mai...
- stavros 1y agoSlapping an MIT license on a compiled binary doesn't make it open source.
- quarters 1y agoThey're keeping some stuff to themselves which is fine. I don't expect anyone to have to fully release everything they've got especially considering the vast costs associated with researching and developing these models. What they have released has been distilled into many new models that others have been using for commercial benefit and I appreciate the contributions that they have made.
- alpaca128 1y ago> I don't expect anyone to have to fully release everything they've got I also don't expect Microsoft to release their full Windows 11 source code, but that also means it's not open source. And that's okay, because Microsoft doesn't call it open source.
- behnamoh 1y agoit's got more 'source' than whatever OpenAI provides for their models.
- stavros 1y agoNo it doesn't, it has exactly the same source, zero. It has more downloadable binary.
- Aeolun 1y agoThat’s the ‘source’ for what the model spits out though, if not the source for what spits out the model.
- prmoustache 1y agoIt is just freeware, not open source.
- stavros 1y agoThe "source" for something is all the stuff that makes you able to build and change that something. The source for a model is all the stuff that makes you able to train and change the model. Just because the model produces stuff doesn't mean that's the model's source, just like the binary for a compiler isn't the compiler's source.
- numpad0 1y agoless alcoholic beverages are fully alcoholic beverages
- fragmede 1y agobut they're not bleach, and no amount of adding or removing alcohol can transmute the alcohol into something else.
- subscribed 1y ago0.5% or 0.03% satisfy my "nonalcoholic" criteria. > Studies have found ethanol levels in commercial apple juice ranging from 0.06 to 0.66 grams per liter, with an average around 0.26 grams per liter[1] Even apple juice is an alcoholic drink if you push your criteria to absurdity. [1] https://pmc.ncbi.nlm.nih.gov/articles/PMC5421578/ https://pmc.ncbi.nlm.nih.gov/articles/PMC5421578/
- echelon 1y agoOpen source is a crazy new beast in the AI/ML world. We have numerous artifacts to reason about: - The model code - The training code - The fine tuning code - The inference code - The raw training data - The processed training data (which might vary across various stages of pre-training and potentially fine-tuning!) - The resultant weights - The inference outputs (which also need a license) - The research papers (hopefully it's described in literature!) - The patents (or lack thereof) The term "open source" is wholly inadequate here. We need a 10-star grading system for this. This is not your mamma's C library. AFAICT, DeepSeek scores 7/10, which is better than OpenAI's 0/10 (they don't even let you train on the outputs). This is more than enough to distill new models from. Everybody is laundering training data, and it's rife with copyrighted data, PII, and pilfered outputs from other commercial AI systems. Because of that, I don't expect we'll see much legally open training data for some time to come. In fact, the first fully open training data of adequate size (not something like LJSpeech) is likely to be 100% synthetic or robotically-captured.
- Tepix 1y agoI think you‘re trying to make it look more complex than it is. Put the amount of data next to every entry in that list of yours.
- echelon 1y agoMost of those items map to a job description. If you think the data story isn't a complicated beast, then consider: If you wanted an "open" dataset, would you want it before or after it was processed? There are a lot of cleaning, categorizing, feature extraction steps. The data typically undergoes a lot of analysis, extra annotation, bucketing, and transformation. If the pre-train was done in stages, and the training process was complicated, how much hand-holding do you need to replicate that process? Do you need all of the scripts to assist with these processes? All of the infra and MLOps pieces? There's a lot of infrastructure to just move the data around and poke it. Where are you going to host those terabytes or petabytes of data? Who is going to download it? How often? Do you expect it to be downloaded as frequently as the Linux kernel sources? Did you scrub it of PII? Are you sure? And to clarify, we're not even talking about trained models at this point.
- cavisne 1y ago"knowing why a model refuses to answer something matters" The companies that create these models cant answer that question! Models get jailbroken all the time to ignore alignment instructions. The robust refusal logic normally sits on top of the model, ie looking at the responses and flagging anything that they don't want to show to users. The best tool we have for understanding if a model is refusing to answer a problem or actually doesn't know is mechanistic interp, which you only need the weights for. This whole debate is weird, even with traditional open source code you cant tell the intent of a programmer, what sources they used to write that code etc.