3 ms·
I remember back when everyone thought Meta was ten steps ahead of the rest of the AI industry and Llama would dominate the field and put OpenAI and Anthropic ou
by paxys 8mo ago
I remember back when everyone thought Meta was ten steps ahead of the rest of the AI industry and Llama would dominate the field and put OpenAI and Anthropic out of business.
Nope, turns out it is just a bunch of out of touch execs throwing shit at the wall and hoping something sticks. Fudging Llama 4 scores. Hiring Alexandr Wang for $14 billion. Making outlandish offers to poach AI talent from OpenAI, Anthropic and Google. Making dubious acquisitions like Manus. Now trying to chase the agents hype by acquiring a company that went viral for 5 minutes and has already been forgotten.
It is laughable how far out of the loop they are, and so desperate to fit in.
- tuananh 8mo agotbh, llama leak was the best thing that happened to the AI/LLM community. Lots of good things happen because of that: LoRA, QLoRA, DPO, RoPE,...
- arugulum 8mo agoLoRA? The parameter-efficient fine-tuning method published 2 years before Llama and already actively used by researchers? RoPE? The position encoding method published 2 years before Llama and already in models such as GPT-J-6B? DPO, a method whose paper had no experiments with Llama? QLoRA? The third in a series of quantization works by Tim Dettmers, the first two of which pre-dated Llama?
- tuananh 8mo agoyou're right. those things predated llama leak. but from my understanding (from the sideline), it's llama that's made them popular and approachable from hacker perspective.