dofm

33 ms·

721.
by dofm 3mo ago
It’s still a dense model so all 27B parameters are active. 35B-A3B activates only 3B at any time.
722.
by dofm 3mo ago
It will when they can get the performance up a bit. My brief experiments with the ternary version suggest that it broadly meets their claim to be a 27B model that fits in much less RAM, that is for sure. It is about as fast as the underlyin
723.
by dofm 3mo ago
I absolutely agree that Gemma 4 writes well out of the box. Free of a lot of the standard American model blog spam writing style but a little more fluid than Qwen.
724.
by dofm 3mo ago
FWIW my tests on my little puzzles suggest that it is not better than the Gemma 4 12B on SQL. It really does seem to get quite tangled up on stuff. PHP/Wordpress code seems OK (better than the Gemma) but it gets stuck in reasoning loop
725.
by dofm 3mo ago
This is somewhat akin to the "one-expert-per-query" solution Apple are using in their small foundation models I think?
726.
by dofm 3mo ago
Have Prism-ML upstreamed their forked code?
727.
by dofm 3mo ago
Not sure if there's any way to run Prism's fork of llama.cpp inside LM Studio. The fork runs fine for me. The model gets very notably stuck in a reasoning loop on one of my simple tests, though it might be that it has the same iss
728.
by dofm 3mo ago
I think they did Gemma 3 QAT models and there are QAT versions of essentially all the Gemma 4 models (including DiffusionGemma).
729.
by dofm 3mo ago
I would be slightly surprised if anything Apple wanted to do with Gemma they couldn't do with Gemini, which they have the right to make various derivatives of. They could more or less redistribute Gemma as-is in the developer program;
730.
by dofm 3mo ago
I do not believe they are panicking, not least because I don't think they've finished adjusting Apple Silicon for the task; it will be very interesting to see what happens in the M6 and M7. I think their strategy is broadly correc
731.
by dofm 3mo ago
They didn't buy Perplexity and it indeed rather seems like Perplexity may have damaged the deal by blurting. Whether things are different now I don't know, but Prism would potentially be a good acquisition. This is not the first B
732.
by dofm 3mo ago
The key point here, I think, is not the 4-bit but the QAT — the model is trained with the objective of losing the least at 4-bit quantiZation (I am assuming it is literally about assigning numbers that quantize better). The 12B QAT model is
733.
by dofm 3mo ago
A caring well-to-do friend who happens to be one of the biggest investors in Tether. The only Reform policy document that was finished before the May elections was the cryptocurrency policy, and Farage happens to have asked the governor of
734.
by dofm 3mo ago
She apparently can say whatever she likes now! I have noticed recently a considerable shift in the press to asking Ed Davey what he thinks. Whatever happens re: Farage, the rules around donations will change, I think. We need to keep money
735.
by dofm 3mo ago
> If Farage wins he is still subject to an investigation that could eject him from Parliament He will win, of course. But Parliament can't actually eject him. All they can do is enable the one mechanism that could: a constituency re
736.
by dofm 3mo ago
OK but what I am telling you is that this has actually damaged Farage's standing in his own party and among his own supporters . There's actual evidence for this. And I presented that scenario in the form Farage understands it.
737.
by dofm 3mo ago
I don't know if Boris ever faked being unintelligent or faked being a man of the people. Or being a bloke from the pub, actually. He did fake being a buffoon , of course, but he was doing that long, long, long before Trump. He is terr
738.
by dofm 3mo ago
He is noticeably more damaged now, believe me. Everyone thinks this election was at least a stupid idea and it is his stupid idea designed for his personal benefit. You are right that it could backfire, but to give you a much longer and
739.
by dofm 3mo ago
> This doesn't make a fool of Farage though! I sense that you are not British, but you can trust us when we say this has absolutely made a fool of him to the British public. This is really a bespoke kind of humiliation.
740.
by dofm 3mo ago
Specifically in this case, Farage is a celebrity populist; he is not likely to lose, and the political system (and the wider British public who oppose him) are conscious of not dancing to his tune. He wanted this election on his own terms;
741.
by dofm 3mo ago
The guardian article cites the OECD study that asserted this. I do think that it took a generation to figure out how to put into the comprehensive school system the same deep focus on “maths and english” that was always the grammar school a
742.
by dofm 3mo ago
Lord Buckethead (the at-that-point temporary novelty candidate) was much closer to (and inspired by) Durham’s character, to be fair. Ultimately it is all for the good; clearly a -face name is much more quintessentially British.
743.
by dofm 3mo ago
FWIW I don’t at all think it’s wrong for people to pick up on whether this would make him a good representative of Clacton were he to win (which isn’t going to happen and he surely thinks it is not). Part of Clacton is relatively well off;
744.
by dofm 3mo ago
Goodness, if Tuberville is average then the USA is in much worse shape than it realises. Mullin, like MTG, has some political instincts and some facility with the parliamentary process, as it turns out, and I almost feel bad about putting h
745.
by dofm 3mo ago
There has apparently been a little bounce in the last few years, a sort of long term consequence of changes made to education policy by New Labour and the consequent movement of teachers from selective education into comprehensive education
746.
by dofm 3mo ago
> I don't know how I feel about the British comedy candidate outclassing half of the American elected leadership–and a good fraction of its industrial leadership–on IQ.) Your entire political system has flirted with anti-intellectua
747.
by dofm 4mo ago
This is a portable format that is used for interchange. The performance may matter elsewhere in your system and yet you may still want to create/access protobuf-packaged data?
748.
by dofm 4mo ago
Graham was not a thorn in Trump’s side as a rule, not after he played golf with the guy. He became a pretty loud supporter. He was, arguably, the US politician most consequential in talking Trump/getting the USA into the Iran conflict,
749.
by dofm 4mo ago
I guess it has policing applications, marginally. But most police forces just use helicopters and night vision, and ultimately rely on the disruptive sound of the helicopter to bring people out to look for whoever they are chasing; the nois
750.
by dofm 4mo ago
Is it possible it can deliver anywhere near enough solar energy to make this economically viable? It's not going to be full daylight, is it?

More ›