kzrdude

6 ms·

61.
by kzrdude 1mo ago
We also had GLM-5.3 flash and Qwen 3.8 Flash Next, everyone's getting flashed and I think it's a good trend. Almost suspect that the rate of improvement to post-training is so fast that small models have an advantage - it takes mu
62.
by kzrdude 1mo ago
As another non-native speaker, I misunderstood what the person meant.
63.
by kzrdude 1mo ago
Colibri did that first for GLM-5.2 https://github.com/JustVugg/colibri
64.
by kzrdude 1mo ago
And there are `Mference` and `SwiftLM` too, I think they are doing the same use case.
65.
by kzrdude 2mo ago
It's worth listening to Lawrence Lessig, speaking in 2011, "Republic Lost" on youtube: https://www.youtube.com/watch?v=Ik1AK56FtVc (It's a "Talk at Google") I think he laid it out very clearly,
66.
by kzrdude 2mo ago
I don't think I can see the difference. I just have my skin crawl because I'm expecting to see something off and generally have a bad feeling about it.
67.
by kzrdude 2mo ago
By the way; I found that DeepSeek says that it is even an "ideal complement to modern MoE architecture" https://arxiv.org/abs/2601.07372v1
68.
by kzrdude 2mo ago
It is compatible, and Qwen3.8 Flash Next is MoE
69.
by kzrdude 2mo ago
They are still industry leaders. They'll have to try to maintain that.
70.
by kzrdude 2mo ago
I guess Nebula is better for video watching, but without recommendations and video comments, it feels dead. I did pay for it for a year and then gave up. Is the problem me?
71.
by kzrdude 2mo ago
I guess it was obscure before, but someone did "know" it: https://old.reddit.com/r/Qwen_AI/comments/1u7xnvq/how_big_is...
72.
by kzrdude 2mo ago
Exactly, DeepSeek, Qwen etc are catching the attention because they put out their tech docs and papers, so we can read about how the models work and what they think their innovation was this time.
73.
by kzrdude 2mo ago
If I read correctly, that's based on a 1-bit quantization, and can we really expect that to produce any useful output at all?
74.
by kzrdude 2mo ago
Not clear to me how it selects that, but it considers it to be #1 out of 173 models "of the same class".
75.
by kzrdude 2mo ago
125B regular params, 51B engrams, 4B MTP. Something like that. It should have a label of effectively 125B params with A6B (6B active).
76.
by kzrdude 2mo ago
They are giving pointers to how to run it now using for example https://recipes.vllm.ai/Qwen/Qwen3.8-Flash-Next (and an especially provided vllm release).
77.
by kzrdude 2mo ago
(Edited: I thought Qwen3.8 Flash Next was smaller, but it's not, in bytes. Here's how they compare.) DSV4 Flash 304B params, 167 GB download (at full size) Qwen3.8 Flash Next 180B params, 360 GB download (at full size)
78.
by kzrdude 2mo ago
Anyone who likes economics or money should see it for what it is, a tax on every transaction. Of course you don't want anyone to lodge themselves into your market and get 3% skimmed off on every transaction. This, for the good of the f
79.
by kzrdude 2mo ago
I guess this is why English Wikipedia was down. It's back up now.
80.
by kzrdude 2mo ago
That reads to me as if the GP confabulated a different exploit target than what the article mentioned (or the article changed), but it's also a threat that should be taken seriously.
81.
by kzrdude 2mo ago
Based on your new information, I think it would be good to test the effect of supplemenths vs supplemints .
82.
by kzrdude 2mo ago
I agree. But models in difference to compiled binaries, are useful as just weights and can be further refined and post-trained, at least. I don't know LLM theory well enough to say if there's some secret sauce they can hold back t
83.
by kzrdude 2mo ago
I'm unnerved by how alphazero is more complicated than the "intelligent llms"; it has at least multiple heads and MCTS, a search algorithm. The LLMs seem to just be monolithic (if complicated) architectures where tokens go in
84.
by kzrdude 2mo ago
This is also the problem, we are continuing with LLMs because they fit hardware well, instead of experimenting with trying to model knowledge (how do I know what I know) and metacognition (what do I know). Current architecture can't te
85.
by kzrdude 2mo ago
In the feedback loop when working on anything UI or graphical output related.
86.
by kzrdude 2mo ago
It seems like attention methods are still evolving, just like residual connections. I’m sure there is a lot left to discover too.
87.
by kzrdude 2mo ago
It beats a frontier model from 12 months according to this bench: https://news.ycombinator.com/item?id=49334544 It is not the whole story, and knowledge is very lacking, but it has gotten a lot of attention. That model toge
88.
by kzrdude 2mo ago
Can it replace pi? Would be good to have a robust and fast replacement.
89.
by kzrdude 2mo ago
Maybe ”agent shell” could be a better term for harness. But it’s pretty overloaded..
90.
by kzrdude 2mo ago
The former

More ›