3 ms·
It's a lot smaller, and runs (quantized) on a 3090 quite well. Ds4 flash 0731 you're talking about? It's great but it's much harder to run locally.
by kadoban 2mo ago
It's a lot smaller, and runs (quantized) on a 3090 quite well. Ds4 flash 0731 you're talking about? It's great but it's much harder to run locally.
- Tepix 2mo agoAre you talking about S or XS? S is too large for a 3090 at 118b parameters.
- kadoban 2mo agoS, I'm running one of the unsloth quants. Q4 something K_XL I think? I don't think it's all resident in memory on the 3090 but it runs fast enough for use, I'd have to check but it's like 30 t/s or so, fast enough that it doesn't bother me.
- ericd 2mo agoI found Laguna S to be pretty good at coding, pretty fast, but pretty bad as an agent - not proactive, would frequently stubbornly argue things that weren't true, and pretty bad general knowledge. But as a pure coding model, pretty good. Deepseek v4 Flash 0731 is so much better if you can run it, though. Grain of salt, I think I grabbed Laguna after they fixed the initial looping issues, didn't notice those, but there might've been other fixes since.
- embedding-shape 2mo ago> But as a pure coding model, pretty good. Yeah, this is my perspective too on Laguna S 2.1. Works amazingly for coding, pretty bad for pretty much anything else. I don't do a lot of advanced math, supposedly it's good for that too.