3 ms·
Yes - they are open weights and open inference code, which means they can be integrated into Ollama. They are not “open training” (either in the training code
by benpacker 3y ago
Yes - they are open weights and open inference code, which means they can be integrated into Ollama.
They are not “open training” (either in the training code or training data sense), so they are not reproducible, which some have suggested ought to be a component of the definition of open models.
- OJFord 3y agoIt really should shouldn't it? I'm quite ML-naïve, but surely providing the model without 'training code or training data' is just like providing a self-hostable binary without the source code? Nobody calls that open source, it's not even source available.
- sunnybeetroot 3y agoThat’s why they’re called open as in free to use how you wish, not open source where the source of the training is also provided.
- OJFord 3y agoBut my point is there's no analogy for that that we call open? It's like self-hostable, or free (as in beer).
- sunnybeetroot 3y agoThat’s a fair comment, maybe free-to-use is more appropriate.
- idiotsecant 3y agoMan, people will find anything to complain about.
- OJFord 3y agoI'm not complaining, I'm unlikely ever to use it (regardless of how open or not it is) so it doesn't really matter to me, just surprised to learn what people mean by 'open' in this context.
- michaelt 3y agoIt is widely believed (and in some cases acknowledged) that a lot of models are trained on copyrighted data scraped from the web. In some cases, even scrapes of ebook piracy websites - google 'books3' to learn more. Some companies (such as those working on AI) believe this is legal, others (such as the copyright holders to those books) believe it isn't. In any case, IMHO it's unlikely any cutting edge models will be offering us their training data any time soon.
- sanroot99 3y agoCan training data be generated from llm,with right prompt?
- etiam 3y agoYes, and there has been some discussion of that Meta’s LLaMa 2 license is not Open Source https://news.ycombinator.com/item?id=36820122 https://news.ycombinator.com/item?id=36820122