Catloafdev

6 ms·

61.
by Catloafdev 2mo ago
I wonder how they detect this kind of thing. Seems like this is going to be a perpetual issue until it stops being worth doing. Side note, didn't they stop releasing real thinking tokens for Fable? Or is it still part of some subs or A
62.
by Catloafdev 2mo ago
It's so full of bullshit marketing prose I don't even know what it actually is.
63.
by Catloafdev 2mo ago
Well that surely isn't a good sign of their financial health. I would have expected this to happen post-IPO.
64.
by Catloafdev 3mo ago
If you read the rest of the article, it breaks down the cost, it's not a misleading title.
65.
by Catloafdev 3mo ago
I expect this will kick off a series of 'GLM helped HuggingFace where Fable wouldn't' type headlines.
66.
by Catloafdev 3mo ago
I mean not only does this not actually address P vs NP but the solution provided isn't even a valid sudoku grid.
67.
by Catloafdev 3mo ago
There are fully open models, it's just not as common because that's basically giving away the sauce, which is non-viable for many. eg: https://allenai.org
68.
by Catloafdev 3mo ago
As someone that's generally for the proliferation of open models, I want to take this seriously, but it's really difficult when it was clearly written by AI. I guess they fired whoever used to write copy for these things. Edit: to
69.
by Catloafdev 3mo ago
This is just wrong on multiple levels, the open source model ecosystem is very much a thing.
70.
by Catloafdev 3mo ago
It's a LLM model, not a phone app. Available on HuggingFace: https://huggingface.co/collections/prism-ml/bonsai-27b
71.
by Catloafdev 3mo ago
Doing some naive math, the F16 filesize is ~53.8gb, the 1-bit version is ~3.8gb, about 7% of the original size. The F16 size is roughly 2x param count, so that gives a rough ballpark of ~110B.
72.
by Catloafdev 3mo ago
DDoS protection is pretty essential. I highly encourage you to read through what they offer if you're not familiar.
73.
by Catloafdev 3mo ago
So the complaint is that one day they have such a strong monopoly that they can freely turn evil? Just want to make sure I understand the real issue here, because that sounds like a lot of fearmongering to me.
74.
by Catloafdev 3mo ago
They're creating optional opt-in protection layers for the services they operate. I genuinely don't understand these generic complaint comments. Are you complaining that they offer too much? Or do you believe nobody is offering si
75.
by Catloafdev 3mo ago
Are you genuinely asking "does anybody even need any of their services"?
76.
by Catloafdev 3mo ago
What Cloudflare competitors offer a similar range of services?
77.
by Catloafdev 3mo ago
How is it hyperbolic when it's literally the subject of the post? Did you not read the OP?
78.
by Catloafdev 3mo ago
Those are people without a better option. Big difference vs xAI, where the sentiment is valid.
79.
by Catloafdev 3mo ago
Well that's not what's happening here, lol.
80.
by Catloafdev 3mo ago
If it weren't a real problem, these types of articles and services wouldn't exist.
81.
by Catloafdev 3mo ago
That's pretty accurate to what I've seen, I'd definitely recommend a smaller model for active agentic use on that hardware. It definitely seems to be the leader on 'general intelligence' on this hardware from my cas
82.
by Catloafdev 3mo ago
Heads up, you can absolutely run DS4 Flash on a 128gb machine - I have it running on my Strix Halo box right now. https://github.com/antirez/ds4
83.
by Catloafdev 3mo ago
It looks like it has 4 tiles on it, no?
84.
by Catloafdev 3mo ago
The demand is not coming from 'normal Apple customers' it's coming from people who want a machine that can run local AI. It has nothing to do with Macs being especially good at AI. It has everything to do with being one of th
85.
by Catloafdev 3mo ago
For most coding or agentic tasks, Qwen 3.6 27B likely outperforms, yes. For 'general intelligence', DS4 Flash seems to be a noticeable step up still.
86.
by Catloafdev 3mo ago
Oh, it is. I was looking at the Huggingface repo which listed the lower number at the top of the page, looks like that's wrong.
87.
by Catloafdev 3mo ago
299B for Hy3 vs 284B* for Flash Edit: fixed, got bad info
88.
by Catloafdev 3mo ago
Curious how people feel about this compared to DS4 Flash, given they are pretty close in size. Also curious how well it holds up to heavy quantization. DS4 Flash can currently run reasonably well on systems with ~96gb+ RAM, I wonder if Hy3
89.
by Catloafdev 3mo ago
Looks great - is there any info on what server resources are actually required per feature or user count?
90.
by Catloafdev 3mo ago
RIP to the end of an era. Was IdTech used outside of Id? Or was it just a Doom series thing as of recently?

More ›