8 ms·
Meta rolls out AI language model LLaMA
- classified 4y agoYes, everyone in the business of luring suckers will grow themselves one of these.
- rvnx 4y agoVery cool to see such model weights getting released. Makes me wonder, seeing that Meta is crushing Google... This is like MySpace teaching a lesson to Apple.
- meragrin_ 4y ago>seeing that Meta is crushing Google... This is like MySpace teaching a lesson to Apple. Huh? How so? I see Meta and Alphabet as very similar companies. Both rely on ads, extracting information from text, keeping users engaged on their platforms, furthering AI/machine learning, etcetera. Does MySpace have their own computing devices I'm unaware of?
- ilaksh 4y agoBut they are not released. Only for non-commercial use by groups that they grant access to. Which means studies funded by giant corporations, or governments using it for their own propaganda, or hackers that steal it or find a leak and use it for spam and phishing etc. Anyone who wants to make something useful and positive is going to be left out.
- pilarphosol 4y agoAI companies seem to be in a paradoxical space where they need the optics of being open even if it goes against their business interests.
- Auracle 4y agoYou know, Google releasing a ChatGPT competitor that could be run locally would really take the wind out of Microsoft's sails without needing to shift their own business model.
- hackernewds 4y agoYan LeCunn seems to be parading that this is open source under GPL V3, which would have been great. However, yes the model weights have not been released and are under a separate non commercial license.
- DennisP 4y ago"Researchers and entities affiliated with government, civil society, and academia" sounds like it might include some positive uses, if you don't assume Meta is maximally evil just for the fun of it.
- luckydata 4y agoI don't see any crushing going on.
- marban 4y agohttps://ai.facebook.com/blog/large-language-model-llama-meta-ai/ https://ai.facebook.com/blog/large-language-model-llama-meta...
- qup 4y agoEven with this it's a little unclear, is this open source? What kind of machine is needed to run it?
- laluser 4y ago> Access to the model will be granted on a case-by-case basis to academic researchers. Non commercial license
- svengrunner2049 4y agoMicrosoft and OpenAI, Google losing $100bn from a bad demo, layoffs, cost cutting pressure to innovate again... I feel the days of full openness in AI research from corporations are over.
- mochomocha 4y agoI think we indeed hit "peak open-source" for AI and there unfortunately won't be as much sharing in the coming years. When the economy is down, people and companies think more in "zero-sum-game". I hope to be proven wrong.
- yacine_ 4y agohttps://twitter.com/EMostaque/status/1629160706368053249 https://twitter.com/EMostaque/status/1629160706368053249 :)
- rvz 4y agoThis is what everyone needs to watch. It was Stability.ai that spooked OpenAI for disrupting DALLE-2 with a open-source AI model; Stable Diffusion. I am betting they are going to do it again for ChatGPT. The endgame for this AI race is obvious and when it comes to AI models, open-source ones always disrupt fully closed source AI companies. But first, we'll see which 'AI companies' will survive the lawsuits, regulations and fierce competition for funding.
- atemerev 4y agoIt really whips…
- russdpale 4y agoI wouldn't trust this with a 10 foot pole. Given facebooks record why would we as a people's even allow this?
- giancarlostoro 4y agoI don't trust Facebook at all, but we need more than just "THE EVIL AI WAS MADE BY AN EVIL COMPANY" what is the concern? They're going to shove ads into your AI?
- freejazz 4y agoThey impermissibly used customer's information in the data set? that they knowingly disregarded known risks of harm associated with the product?
- return_to_monke 4y agogot any citations on that one, mate?
- freejazz 4y agoI didn't make any claims, someone asked what could facebook do that would be of concern, and I gave two examples of their past conduct.
- giancarlostoro 4y agoI would hope not, have you seen the dumb stuff my relatives say? I think you need to provide some evidence to back your claim though.
- freejazz 4y agoI didn't make any claims - someone asked what could they have done, and I listed two things they did recently...
- 4y ago
- MongoTheMad 4y agoThe name made me think of this: https://youtu.be/KMYN4djSq7o https://youtu.be/KMYN4djSq7o
- mmahemoff 4y agoIt made me think of Winamp.
- RheingoldRiver 4y agoah, I expected that to be this: https://www.youtube.com/watch?v=kZUPCB9533Y https://www.youtube.com/watch?v=kZUPCB9533Y
- thom 4y agoOr this: https://www.youtube.com/watch?v=gTmEfoPnQDo https://www.youtube.com/watch?v=gTmEfoPnQDo
- dukoid 4y agoBetter than LMAA I guess O:) https://en.wikipedia.org/wiki/Swabian_salute https://en.wikipedia.org/wiki/Swabian_salute
- waynesonfire 4y agoThere will one day be a wikipedia equivalent organization that maintains a language model.
- behnamoh 4y agoAll of this just to stay relevant among the competition, and yet, none of these AI giants has introduced something that just works.
- cryoz 4y agoWaiting for Apple.
- jocaal 4y agoWhat makes you think that apple can even compete at all? The businesses they are competing with in this space have actual monetary incentive to do research in the field, this sounds like the comments people make about apples electric cars and AR headsets that are always just around the corner and better than anything that already exists
- simonh 4y agoThat's fair. Apple does work on all kinds of stuff that never makes the light of day, mainly because it shouldn't. It's not better than the competition until it ships and proves it in the market. Apple have their misses too. I'm not convinced Apple needs to, or is interested in competing in this space. Yes they have Siri, but there's no guarantee these language models will ever actually be safely functional in a role like that. Even if they are, is this really an interface people will want to use? I did use Siri to set alarms and such for a while, but even though it did it reliably and conveniently, eventually I stoped bothering. Who want's to talk to their phone on the train? I just found it cognitively less intrusive to just set alarms manually.
- hummus_bae 4y ago[dead]
- nothing0001 4y agoHow can they avoid that someone perform a post-training from this model to obtain a different model that perhaps could not be protected by copyright?
- bluetidepro 4y agoRelated discussion: https://news.ycombinator.com/item?id=34925944 https://news.ycombinator.com/item?id=34925944
- luckydata 4y agothe level of the comments in this post is disappointing for hacker news.
- dougmwne 4y agoAbsolutely. From what I can tell, this model hits state of the art on several benchmarks at 1/10 the size of its benchmark winning competitors. That performance efficiency is great to see because while we know we can increase performance by scaling up the size and compute requirements, getting the same performance out of a fraction of the compute is a major win. This will be especially valuable as these models begin to see real production use at scale such as with ChatGPT and Bing. HN seems to have mostly devolved into skepticism, hype and confusion lately around all things AI. I’d say we have just hit futureshock.
- PhillyPhuture 4y agoThe language model that lies better than any other model in the universe? (just guessing from the training data)
- a-dub 4y agothe focus on non-proprietary training datasets and computational efficiency for the purposes of reducing costs and democratizing access is pretty cool! it is interesting how model performance seems to scale almost linearly with size for the sizes chosen. (or perhaps not, perhaps the researchers are choosing to focus on the part of the performance-size response curve that is linear).
- karaterobot 4y ago> Meta's LLaMA, short for Large Language Model Meta AI I would have said "LLaMA, an acronym based on cramming concepts together until the word Llama is suggested, and then as a flourish, adding an unnecessary lower-case letter 'a' in the middle. Llamas are unrelated to AI, so this should not have been anybody's priority." Guess that's why I'm not a writer.
- deburo 4y agoAs long as it is pronounceable, memorable, it's actually a good one.
- _puk 4y agoAlso known as a "Backronyn". Start with the acronym you want, and work back from there..
- nonbirithm 4y agoAt least it's better than LION (evoLved sIgn mOmeNtum). https://arxiv.org/abs/2302.06675 https://arxiv.org/abs/2302.06675
- rcme 4y agoThat's a cool acronym, if only for the novelty.
- jejeyyy77 4y agodumb question - but - can we actually use this right now? Like download the model and run it locally?
- idlewords 4y agoIt's a funny accident of history that one company's business model in 2023 is a combination of: 1. Large interactive language model 2. Wireless helmet for 3D equivalent of conference calls 3. Helping you keep track of which classmate from high school went bald 4. Birthday reminder service 5. Virtual currency intended to compete with the dollar 6. Running all school and church message boards in the US 7. World's largest collection of food photography 8. Instant messaging
- esalman 4y agoEver heard of Facebook marketplace? Besides every mom and pop shop uses FB pages and groups these days. With mobile carriers supporting free bandwidth for FB it's basically part of infrastructure in many 3rd world countries.
- idlewords 4y agoYou are completely right; I should have known I'd forget about entire lines of business making that list.
- tannhauser23 4y agoThey dropped the currency idea.
- zmmmmm 4y agoIs there something special about this that would motivate someone to bother when they can access alternatives with less restrictions / more openly?
- mirker 4y agoThe model has less technical debt from being newer. The quality per cost is supposed to be good.