8 ms·
Everything we announced at our first LlamaCon
- mohsen1 1y agoI am guessing because of Qwen 3 release they pulled back the reasoning model that was likely due to launch today.
- htrp 1y agoalibaba stole Facebook's lunch money
- logicchains 1y agoNo new model? Maybe after the Qwen 3 release today they decided to hold back on Llama 4 Thinking until it benchmarks more competitively.
- smcnally 1y agoBeyond solid benchmarks, Alibaba's power move was dropping a bunch of models available to use and run locally today. That's disruptive already and the slew of fine tunes to come will be good for all users and builders. https://huggingface.co/collections/Qwen/qwen3-67dd247413f0e2e4f653967f https://huggingface.co/collections/Qwen/qwen3-67dd247413f0e2...
- walterbell 1y agoWhat's the minimum GPU/NPU hardware and memory to run Qwen3 locally?
- dpe82 1y agoQwen3 is a family of models, the very smallest are only a few GB and will run comfortably on virtually any computer of the last 10 years or recent-ish smart phone. The largest - well, depends how fast you want it to run.
- Havoc 1y agoThere is a 0.6B model so basically nothing. And the MoE 30B one has a decent shot at running OK without GPU. I'm on a 5800x3d so two generations old and its still very usable
- smcnally 1y ago`model.safetensors` for Qwen3-0.6B is a single 1.5GB file. Qwen3-235B-A22B has 118 `.safetensors` files at 4GB each. There are a bunch of models and quants between those.
- azinman2 1y agoDoes it run in 8x80G? Or does the KV cache and other buffers push it over the edge?
- littlestymaar 1y agoThere are models down to 0.6B and you can even run Qwen3 30B-A3B reasonably fast on CPU only.
- laweijfmvo 1y agoI'm running 4B on my 8GB AMD 7600 via ollama
- NitpickLawyer 1y ago> Beyond solid benchmarks, Alibaba's power move was dropping a bunch of models available to use and run locally today. I agree, the advantage of qwen3's family is a plethora of sizes and architectures to chose from. Another one is ease of fine-tuning for downstream tasks. On the other hand, I'd say it's "in spite" of their benchmarks, because there's obviously something wrong with either the published results, or the way they measure them, or something. Early impressions do not support those benchmarks at all. At one point they even had a 4b model be better than their prev gen 72b model, which was pretty solid on its own. Take benchmarks with a huge boulder of salt. Something is messing with recent benchmarks, and I don't know exactly what but I have a feeling that distilling + RL + something in their pipelines is making benchmark data creep into the models, either by reward hacking, or other signals getting leaked (i.e. prev gen models optimised for one benchmark are "distilling" those signals into newer smaller models. No, a 4b model is absoulutely not gonna be better than 4o/sonnet3.7, whatever the benchmarks say).
- paxys 1y agoThey released the Llama 4 suite three weeks ago.
- throwaw12 1y agoFeels like Meta is going to Cloud services business but in AI domain. They resisted entering cloud business for so long, with the success of AWS/Azure/GCP I think they are realizing they can't keep at the top only with social networks without owning a platform (hardware, cloud)
- throwaw12 1y agoSAM 3 (Segment Anything Model) is coming this summer
- daemonologist 1y agoSAM's a really cool model, that's something to look forward to. I didn't see that in the LlamaCon notes, is that something they've announced elsewhere or just a rumor atm?
- ipsum2 1y agoIt was mentioned briefly. https://ai.meta.com/sam3 https://ai.meta.com/sam3
- swatcoder 1y agoThey seem to see tge writing on the wall and have been panicked for a while, yes. Gobbling up rising brands kept their finances going for a while, but the grand Metaverse pivot was clearly their (much struggling) attempt to invent their own titanic platform akin to Android or iPhone. With that not gaining as much traction as they wanted as quickly as they wanted, they're still on the hunt, as here.
- retinaros 1y agoThe metaverse is a great idea but they should have partnered with Epic for this or Valve. The implementation was subpar
- 1y ago
- retinaros 1y agodid I read well that they have a gated 3.3 8b?
- yapyap 1y agoWas there a ball pit
- oofbaroomf 1y agoYeah, it was for the Llama team because they love playing in ball pits instead of releasing good models.
- mgdev 1y agoThere is a potential world where Meta uses AI as a vector to tap into the home. Like, literally building smart homes. Locally intelligent in ways that enable truly magical smart home experiences while preserving privacy and building trust. But connected in ways that facilitate pseudo-social interactions, entertainment, and commerce. Meta's biggest competitors are Apple and Amazon. This is the first clear opportunity they've had to leapfrog both.
- OtherShrezzing 1y ago>There is a potential world where Meta [is]... literally building smart homes... while preserving privacy and building trust I'm earnestly not sure what Meta are less qualified for. Building physical homes or building privacy & trust.
- mgdev 1y agoVisit SE Asia sometime and you'll experience a very different sentiment. Hundreds of millions of people rely on Meta to provide valuable services every day, some of them borderline essential. This is undebatable. The outsized public hatred toward Meta is almost entirely driven by a bureaucratic, anti-technology Europe (that has finally realized that their overstepping is hurting their future) and a US political institution that needed someone to demonize to keep us all distracted. There are very good reasons to dislike Meta and Meta products. But they're likely not the ones you're referring to.
- stcroixx 1y agoDumb fucks is what the founder of the company has thought about it's users since day 1. They've been caught lying to cover up terrible things they've done so many times it's just assumed at this point. Anyone relying on their services is being taken advantage of first by Meta, and then by their own failed economy that won't provide an alternative. I've never once considered what Europe thinks.
- pzo 1y agoWhat kind of services? IM app? Thailand uses LINE, Vietnam: Zalo, Cambodia and Myanmar Telegram and Viber, in Indonesia many uses few IM at the same time.
- oulipo 1y agoMeh
- ilrwbwrkhv 1y agoLmao why are they doing LlamaCon, a convention with a subpar product?
- kepler1 1y agoThis actually a legit question under the surface. The problem, in my opinion, is that MZ/CC/AA-D, are feeling that they have to be releasing models of some flavor every month to stay competitive. And when you have the rest of the company planning to throw you a on-stage party to announce whatever next model, and the venue and guests are paid for, you're gonna have the show whether the content is good or not. Llama program right now is "we must go faster." But without a clear product direction or niche that they're trying to build towards. Very little is said no to. Just be the best at everything. And they started from behind, how can you think you're gonna catch up to 1-2 year head start, just with more people? The line they want to believe is "the best LLM, not just the best OSS LLM". Because of the constant pressure to release something every month (nearly, but not a huge exaggeration), and the product direction coming from MZ himself, the team is not really great at anything. There is a huge apparatus of people working on it, yet half of it or more, I believe, is baggage required because of what Meta is. I guess we'll see how long this can be maintained.
- Havoc 1y agoUnlucky timing for meta...
- littlestymaar 1y agoIt's not about luck, pretty sure that Qwen intentionally bullied them.
- ahmedfromtunis 1y agoDoes anyone use llama as their primary model for any usecase? Maybe it's my fault for not spending much time with it, but I still couldn't find the applications for which llama has an advantage over the competition.
- philipkglass 1y agoI recently needed to classify thousands of documents according to some custom criteria. I wanted to use LLM classification from these thousands of documents to train a faster, smaller BERT (well, ModernBERT) classifier to use across millions of documents. For my task, Llama 3.3 was still the best local model I could run. I tried newer ones (Phi4, Gemma3, Mistral Small) but they produced much worse results. Some larger local models are probably better if you have the hardware for them, but I only have a single 4090 GPU and 128 GB of system RAM.
- galeos 1y agoHow did you find ModernBERT performance Vs prior BERT models?
- philipkglass 1y agoI didn't try original BERT at all because I didn't get good results from any LLMs on small document excerpts, so I assumed that a substantial context was necessary for good results. Traditional BERT only accepts up to 512 tokens, while ModernBERT goes up to 8192. I ended up using a 2048 token limit.
- stavros 1y agoWould you happen to know of any resources for how to distill a ModernBERT model out of a larger one? I'm interested in doing exactly what you did, but I don't know how to start.
- philipkglass 1y ago
- wewewedxfgdf 1y agoCan someone explain to me please why Meta doesn't create subject specific versions of their LLMs such as one that knows only about computer programming, computers, hardware software. I would have imagined such a thing would be smaller and thus run on smaller configurations. But since I am only a layman maybe someone can tell me why this isn't the case?
- KTibow 1y agoOther companies have done this (see Qwen Coder). It doesn't scale past a few disciplines like math and code though, and using mixtures of experts give you most of the same benefits.
- littlestymaar 1y agoUnlike what their names imply, MoE don't have a concept of domain expert at all. It's just a fancy name for sparse evaluation of the total network to save compute and memory bandwidth.
- cube2222 1y agoGenerally, all that non-tech content still helps the model “to learn”. Also, the software you’re working on will generally in some way have a real-world domain - without knowing it the AI all likely be a less effective assistant. Design conversations with it would likely be pretty non-fun, too. Finally, the “bitter lesson” article[0] from a couple years ago is I think somewhat applicable too. [0]: http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html
- bbatha 1y agoTo add on to the sibling. Specialized models, including fine tuned ones, continually have their lunch eaten by general models within 3-6 months. This time round is mixture of experts that’ll do it, next year it’ll be something else. Tuned models are expensive to produce and are benchmark kings but less do less well in the real world qualitative experience. The juice just ain’t worth the squeeze most of the time. Meta does have some specialized models though, llamaguard was released for llama 2 and 3.
- hedayet 1y agoFacebook did a great job open sourcing Llama and pushing the market to being competitive, but this list seems super shallow. 0. Introducing Llama API in preview This one is good but not centre stage worthy. Other [closed] models have been offering this for a long time. 1. Fast inference with Llama API How fast? and how must faster than others? This section talks about latency and there's absolutely no numbers in this section! 2. New Llama Stack integrations Speculations with 0 new integration. Llama Stack with NVIDIA had already been announced and then this section ends with '...others on new integrations that will be announced soon. Alongside our partners, we envision Llama Stack as the industry standard for enterprises looking to seamlessly deploy production-grade turnkey AI solutions.' 3. New Llama Protections and security for the open source community This one is not only the best on this page, but is actually good with announcement of - Llama Guard 4, LlamaFirewall, and Llama Prompt Guard 2 4. Meet the Llama Impact Grant recipients Sorry but neither the gross amount $1.5 million USD, nor the average $150K/recipients is anything significant at Facebook scale.
- amusingimpala75 1y agoMeta needs to stop open-washing their product. It simply is not open-source. The license for their precompiled binary blob (ie model) should not be considered open-source, and the source code (ie training process / data) isn’t available.
- bbayer 1y agoThis is actually my first impression while I am reading the post. Mentions "open source" everywhere but dude how the earth it is open source without training data.
- ronsor 1y agoAlmost no company is going to release training data because they don't want to waste time with lawsuits. That's why it doesn't happen. Until governments fix that issue, I don't even think the "it's not really open without training data!!!" argument is worth any time. It's more worth focusing on the various restrictions in the LLaMA license, or even better, questioning whether model weights can be licensed at all.
- observationist 1y agoThey've painted themselves into a corner - the second people see the announcement that they've enforced the license on someone, people will switch to actual open source licensed models and Meta's reputation will take a hit. It's ironic that China is acting as a better good faith participant in open source than Meta. I'm sure their stakeholders don't really care right now, but Meta should switch to Apache or MIT. The longer they wait the more invested people will be and the more intense the outrage when things go wrong.
- piperswe 1y agoApplying Apache or MIT to a binary blob doesn't make it open source either
- littlestymaar 1y ago
- blitzar 1y agoIts impressive that Llama and the Ai teams in general survived the meta-verse push at Facebook. Congrats to the team for keeping their heads down and saving the company from itself. Its all Ai all the time now though, not seen any mention of our reimagined future of floating heads hanging out together in quite some time.
- testfrequency 1y agoIt’s coming: https://www.uploadvr.com/meta-employees-reportedly-working-weekends-to-ship-hud-glasses-in-october/ https://www.uploadvr.com/meta-employees-reportedly-working-w...
- divan 1y agoI'm working in Quest 3 almost every day. I use Immersed, as it implements virtual displays for my MacBook better than others, but I'm impressed with the Meta ecosystem. Granted, social interaction is still awkward without proper face expressions, but it feels closer each year to the depicted vision. I recently travelled and needed to work (coding and video editing in DaVinci) a lot in hotels and random places. I can't bring large screens everywhere (and I hate to work with small fonts and screens), and Quest 3 was a perfect fit here. Sometimes at home or office (I have a private one), I just don't want to sit on my buttoks all the time, so I put on VR goggles and can keep working in any position (lying on a sofa or even sunbathing outdoors). As soon as new XR/MR glasses become lighter (there are some good ones already - Visor, Beyond BigScreen 2, etc), more and more people will discover how usable and optimized for work this tech is.
- bigyabai 1y agoI'm quite a big fan of my Quest 1 as a cheap flight sim headset, too. I don't end up using it more than maybe twice a week, but that's more than worth-it for the $400 I paid 5 years ago. It installs (or "sideloads" in present vernacular) Android apps like any other device, browses the web, and streams wireless VR from my desktop via ALVR when I want to play games. It does a lot of stuff you wouldn't expect out of a "depreciated" piece of hardware. The trepidation behind VR for professional applications makes sense to me - it's expensive and tough to compare with what it's replacing. As a pure vehicle for fun though, I genuinely have no regrets with my Quest hardware. It was easily a better purchase than my Xbox One.
- scosman 1y agoAnyone manage to sign up for the waitlist? I just get a redirect loop back to the login when requesting access.
- nailer 1y agoThis is odd - it keeps mentioning Open Source but the Llama license isn’t open source at all - see https://www.llama.com/llama3/license/ https://www.llama.com/llama3/license/. The “additional commercial terms” section violates the open source definition as does the advertising clause. I would’ve hoped to have seen Meta, in their supposed dedication to open source, actually fix it.
- nailer 1y agohttps://github.com/meta-llama/llama3/issues/156 https://github.com/meta-llama/llama3/issues/156 if anyone else feels like commenting
- jsfunfun 1y ago[flagged]
- andhuman 1y agoI had higher expectations of this. I was hoping they would release an Omni type model that could handle voice input and output voice. Oh well.
- deleted 1y ago[deleted]
- kennethologist 1y agoMeta announced several key updates to enhance building with Llama and strengthen the open-source ecosystem: 1. Llama API Preview: Launched a limited preview of the Llama API, a developer platform simplifying Llama application development with easy API key creation, playgrounds, SDKs, and tools for fine-tuning and evaluation. It emphasizes model portability and privacy. 2. Fast Inference Collaborations: Announced collaborations with Cerebras and Groq to offer developers access to faster Llama model inference speeds via the Llama API. 3. Expanded Llama Stack Integrations: Revealed new and expanded Llama Stack integrations with partners like NVIDIA, IBM, Red Hat, and Dell Technologies to make deploying Llama applications easier for enterprises. 4. New Llama Protection Tools & Program: Released new open-source security tools including Llama Guard 4, LlamaFirewall, and Llama Prompt Guard 2, updated CyberSecEval 4, and announced the Llama Defenders Program for partners to help evaluate system security. 5. Llama Impact Grant Recipients: Announced the 10 international recipients of the second Llama Impact Grants, awarding over $1.5 million USD to support projects using Llama for transformative change. Overall, the announcements emphasize making Llama more accessible, easier to build with, faster, more secure, and supporting its diverse open-source community.
- WhitneyLand 1y agoIf you’re going to post AI slop comments, one way to make them more appreciated is to make a human editing pass at it. For example, the entire first sentence could be collapse to “Announcements”. Some sentences are just pablum entirely. It’s helpful to post summaries here, but they need to be curated.
- icapybara 1y agoEh, it's fine. Saves some people from pasting it into ChatGPT themselves.
- WhitneyLand 1y agoNot sure how we disagree, I’m saying save people even more time by cleaning it up.
- zoobab 1y ago"Open source" greenwashing. Still no training data in sight.
- bentt 1y agoThis company is so untrustworthy, I don't see how anyone could dedicate any time to working with their platform or technology. Any acts of benevolence that they are putting forth now are sure to be followed by the most underhanded rug pulls you can imagine. My guess is that they'll let the model out for free, but they'll want to own the "memory" that defines people that use it. Who knows, but they're definitely thinking about the future beyond just playing defense and using FB Ad money to artificially compete in this space by giving things away.