3 ms·
This is more exciting than k3, IMO. Dsv4 models are extremely cheap to serve. Improving their capabilities has lots of downstream effects, as it becomes "good e
by NitpickLawyer 3mo ago
This is more exciting than k3, IMO. Dsv4 models are extremely cheap to serve. Improving their capabilities has lots of downstream effects, as it becomes "good enough" for more and more tasks.
DS was serving the pro version at extremely low prices for a long time, and they've had integrations with opencode & other providers, so they likely gathered a lot of data from real developers doing real tasks (on openrouter they were labeled as such). Now they can use those live scenarios to further post-train their models and improve them further.
Can't wait to see if distilling k3 into dsv4 brings additional improvements. Anyway, having fast cheap models getting better is great for the community. Especially since these don't "go away" on a provider's whim. Whatever capabilities they get, can be used "forever" going forward. And, at least flash can be ran "at home" with <10k in hardware, which isn't really possible / feasible with glm/k3 larger models.
- dnhkng 3mo agoTotally! This with DwarfStar delivers usable local AI (I hope!)
- dannyw 3mo agoUsable local AI has been here for a while, esp on say a 5090. You can’t treat Qwen3.6 like its fable, but if you prompt precisely and specifically it’s a great executor. I actually found it refreshing to use more of my brain for once, and actually have to think deeper about what I’m trying to do, and how to build it.
- Tepix 3mo agoWhat are your goalposts? Depending on your requirements, there have been many moments of usable local AI. More recent ones were gpt-oss 120b and Qwen 3.6 27b.
- genxy 3mo agoParent is referring to https://github.com/antirez/ds4 https://github.com/antirez/ds4
- KaseyKim 3mo agohope that deepseek become better
- ilaksh 3mo agoHave you tried the one that was just released?
- chorizo 3mo agoStarting to wonder if the free big pickle model on opencode has been DSV4F0731 for the past few months. It’s been incredibly fast and good.
- kevincox 3mo agoAt least in the past it was GLM-4.6. IDK if it is ever changed. https://github.com/anomalyco/opencode/issues/4276 https://github.com/anomalyco/opencode/issues/4276
- chorizo 3mo agoI’ve heard that too, but since it’s a stealth model, I suspect they change it to whatever preview model provider that offers a free endpoint. In the past few months, I’ve gotten 4xx errors identifying the provider as DeepSeek.
- dotancohen 3mo ago> Whatever capabilities they get, can be used "forever" going forward. "Forever" gets the scare quotes because it is implied only up until the Butlerian Jihad?
- sigzero 3mo agoI upvoted you just for the Dune reference.
- idiotsecant 3mo agoI feel like once they make a mega successful movie of a book we can stop doing the secret handshake.
- trvz 3mo agoEspecially when the movie is over forty years old.
- idiotsecant 3mo agoI don't think 1984 dune was successful culturally or financially. Definitely a different beast from the recent attempt, which has been wildly popular.
- dotancohen 3mo agoThe only movie I've ever enjoyed after reading the book was Jurassic Park. I've never seen the Dune movies or most other book-based movies, but honestly The Martian and Project Hail Mary were tempting. I'll probably surrender to one of those two someday.
- addaon 3mo agoThe most recent Dune movies pull off the incredible feat of being a better telling of the tale than the book, but only if you already know the tale from the books. They’re not beginner-friendly, but they’re extremely respectful to the book reader, while still make conscious (and in my opinion, positive) changes to the story.
- teravor 3mo agodistilling K3 into DS4 flash will likely only be a good idea for specialists. the difference in model capacity is otherwise too large. we used to distill GLM 5.2 into Qwen 27B specialists with great success. developing the workflows is tricky though. we had the advantage of a straightforward mapping function in mind: English -> SQL which was relatively easy to pipeline training for.
- Demiurge 3mo agoWhy would you do this?
- teravor 3mo agoa specialist model sufficiently post-trained can outperform a frontier model while being dirt cheap. what we did was distill GLM 5.2 into a 27B model on SQL and then post-train it with RL afterward. the result outperformed even Fable on that one task. the distillation step is just good sense in this workflow, to bootstrap a smaller model to the utmost you can before actually doing RL.