6 ms·
I think that focusing primarily on the discussion of what is or isn't open source software makes us miss an interesting point here, that Llama enables users to
by thor-rodrigues 2y ago
I think that focusing primarily on the discussion of what is or isn't open source software makes us miss an interesting point here, that Llama enables users to have a similar performance to frontier models in your own systems, without having to send data to third-party sources.
My company is building an application for an university client, regarding the examination of research data written in "human language" (mostly notes and docs).
Due the high confidentiality of the subjects, as often they deal with non-patented information, we couldn't risk using frontier models, as it could break the novelty of the invention, therefore losing patentability.
Now with Llama3.1, we can simply run these models locally, on systems that is not even connected to the internet. LLMs are mostly good in examining massive amount of research papers and information, at least for the application we are aiming at, saving thousands of hours of tiresome (and very boring) human labour.
I am trying to endorse Meta or Zuckerberg or anything like that, but at least in this aspect, I think Llama being "open-source" is a very good aspect.
- jstummbillig 2y agoTo me it's fairly interesting how relatively little money it takes meta to pose a risk to other models makers businesses, who are dependent on having to run the model after they created it (because that is how they make money) while meta does not even have to deal with the cost attached to providing inference infra, at all, to pose that risk.
- honorious 2y agoCan you expand on the risk of breaking novelty? Is the concern that prompts could be re-used for training by the provider and such knowledge become part of the model?
- koolala 2y agoCan you imagine how incredible an open source model would be for research / humanity beyond the buisness needs right in front of us? Open-Knowledge source with an Open-Inteligence that can guide you through the entire massive digital library of its own brain. Semantic data light-years beyond a Search Engine.
- talldayo 2y agoNo, I really can't imagine it. Extrapolating from our free commercially-licensed offerings it would seem most people would ignore it or share stories on Reddit about how FreeGPT poisoned their family when generating a potato salad recipe.
- koolala 2y agoAn open source model would be able to give you the sources of its potato salad recipe inspiration. It would be the best of both worlds. AI Knowledge + Real Open Human Knowledge.
- JumpCrisscross 2y ago> open source model would be able to give you the source of its potaeo salad recipe Kagi’s LLM can already do that. I believe so can Perplexity’s. Citing sources isn’t something only open models can do.
- koolala 2y agoI'm pretty sure Kagi is like a normal search engine with AI integration like Google. Not an AI designed to be open source with an open dataset of knowledge it was trained on.
- JumpCrisscross 2y ago> pretty sure Kagi is like a normal search engine with AI integration like Google Sure. The point is the thing you said only an open-source model can do, it can do. Plenty of proprietary LLMs can cite sources. The plain truth is most of the benefits of open models are not on the consumer side. (Or at least, I haven't seen any articulated.) They're on the producers'. Open models are better for those of us training models. That's partly why the open data debate is academic--very few people are training large foundation models because the compute and electricity costs are prohibitive.