3 ms·
The initial Llama 4 release is disappointing: the models are too big for most people to run, and not high quality enough be worth running if you can afford the
by simonw 2y ago
The initial Llama 4 release is disappointing: the models are too big for most people to run, and not high quality enough be worth running if you can afford the hardware.
I'm still optimistic for Llama 4.1 and 4.2.
Llama 3 got exciting at the 3.2 and 3.3 stages: smaller models that were distilled from the big ones and ran on a laptop (or even a phone).
3.2 3B and 3.3 70B were really interesting models.
I'm hopeful that we will get a Llama 4 ~25B, since that seems to be a sweet spot for laptop models right now - Gemma 3 27B and Mistral Small 3.1 (24B) are both fantastic.