SwellJoe

15 ms·

361.
by SwellJoe 4mo ago
Get some help, friend. You're spiraling over the weirdest thing in the world to spiral about.
362.
by SwellJoe 4mo ago
I am not HN. I'm just one guy. And, I have not, in recent memory, said anything nice about Zuckerberg.
363.
by SwellJoe 4mo ago
The unusual bootloader and custom hardware makes modifying and upgrading the OS a challenge. I work on robots that need a custom OS image loaded on the machine. The Nvidia Ubuntu version makes that a huge pain in the ass. They've got b
364.
by SwellJoe 4mo ago
Yeah, folks should be aware that if you're filling up the memory on a Strix Halo for an inference workload, you're going to be getting uncomfortably slow token rates. Like, DS4 (a 1-bit quantization of DeepSeek V4 Flash) runs at s
365.
by SwellJoe 4mo ago
I have a Strix Halo device, and like it, but at this price, might as well buy the Nvidia-based ASUS GX 10, if you're buying it for AI. CUDA remains the stronger ecosystem. The AMD is a better desktop machine, as it has a better CPU, bu
366.
by SwellJoe 4mo ago
You talking about me?
367.
by SwellJoe 4mo ago
Zuckerberg is proof you only need to get really lucky once. He's basically flailed at leading facebook ever since, going all in on monumentally dumb bets and erratically making headcount and project decisions, and still he somehow keep
368.
by SwellJoe 4mo ago
Ah,yes, the world cries out for more JavaScript frameworks.
369.
by SwellJoe 4mo ago
Indent for code blocks is a non-starter. Can't paste easily, very annoying to type in a web form. Triple backticks is the right thing.
370.
by SwellJoe 4mo ago
API pricing ends up being something like 20x more expensive for GPT 5.5 Pro than GPT 5.5 for actual work, even though the token cost is "only" 6x. On benchmarks where I've run both, I saw $1.12 mean per task with 5.5 and near
371.
by SwellJoe 4mo ago
I didn't plan to go into the printer manufacturing business, and there's nothing more open, AFAIK. HP won't let you fix it when they brick your printer for not using their more expensive than blood ink.
372.
by SwellJoe 4mo ago
There are still quality laser printers on the market without extortion and surveillance built-in, unlike inkjets. The need for an open laser printer is less dire than for an open inkjet.
373.
by SwellJoe 4mo ago
What about that license makes you think you can't use the device (i.e. print things) for commercial purposes? The license applies to the thing, not the thing you print using the thing. Me writing software or prose on a computer runni
374.
by SwellJoe 4mo ago
I think this makes two incorrect assumptions: 1. That a human, even a brilliant human with a lot of experience, can sit down and one-shot a language spec for a new language that is actually good. 2. That an agent can produce code that is go
375.
by SwellJoe 4mo ago
The thing about Zig in these times is that it proves that software development as a craft is not dead or replaced by LLMs. Even though I use LLMs every day, and have to admit they're remarkably good at many classes of problem, I don&#x
376.
by SwellJoe 4mo ago
If you're not logged in, nothing risque shows up. But, if you are logged in, and search for many kinds of image LoRA, e.g. "realism" or "natural skin", many, maybe most, of the example images would be R or X or XXX
377.
by SwellJoe 4mo ago
X-rated is like 90% of all self-hosted content generation. (Before they removed all the X-rated stuff, CivitAI was impossible to navigate for anything that wasn't smut. Nothing wrong with smut, mind you, but it was really something, qu
378.
by SwellJoe 4mo ago
The Gemma 4 QAT 4-bit models are basically indistinguishable from the 8-bit or 16-bit versions. I tested, and many benchmarks agree. For models where there isn't a QAT version, 6-bit is where it starts to degrade, but only a little if
379.
by SwellJoe 4mo ago
OK, that's true, too, but they have a vested interest in GLM being as good as possible. They're nipping at the heels of the big guys, they don't want to ruin that by hobbling their best model with a lossy quantization.
380.
by SwellJoe 4mo ago
I recently wrote up how I run local LLMs, because several folks had asked ( https://swelljoe.com/post/how-i-run-local-llms/ ) and I think even my setup, which I spent maybe $4200 on, half on a Strix Halo and half on
381.
by SwellJoe 4mo ago
We're past the point where there's a feasible argument that there is an AI winter coming. The models work remarkably well for several classes of problem that seemed impossible a few years ago. They're not going away. There wi
382.
by SwellJoe 4mo ago
I build a lot of my own tools, to suit exactly how I want to work. Obviously, having a little thinky guy in the computer to do most of the busy work of making new tools accelerates that, but tools that make the LLMs suit me also accelerates
383.
by SwellJoe 4mo ago
Ah, yeah, a model ten times as large on disk will know more, for sure. My tasks are more about "what's happening in this image?" rather than "what is this thing?", which doesn't require encyclopedic knowledge,
384.
by SwellJoe 4mo ago
No idea why Docker is still so much more popular than Podman. Podman is obviously the better implementation. The new network stuff is a welcome improvement.
385.
by SwellJoe 4mo ago
The current dense models from Gemma 4 or Qwen 3.6 families will run well on a consumer GPU with 32GB in a 4-bit quantization (which is a little lossy for Qwen 3.6, not so much for Gemma 4, as it has a QAT 4-bit version). Even an Intel ARC B
386.
by SwellJoe 4mo ago
A 4-bit quantization of either Qwen 3.6 27b or Gemma 4 31b will run on a 32GB Mac with a decent-sized, but not full-sized, context. 64GB gets you the full ~256k context and you don't need to quantize your KV cache (though 8-bit quantiz
387.
by SwellJoe 4mo ago
I do, in fact, think the AI companies software is serious slop. I've read some of the Claude Code source. And, we're not talking about hypothetical attacks here. Prompt injection attacks have happened. Supply chain attacks that ag
388.
by SwellJoe 4mo ago
I don't run anything but the agent and the project it's working on and the tools it needs to work on the project in the VM. You can't see how the agent having no access to anything other than what it's working on is safe
389.
by SwellJoe 4mo ago
Can you?
390.
by SwellJoe 4mo ago
That's also true if you're running the agent directly on your laptop OS. In that case, maybe you want VMs at hosting providers. There are companies building ephemeral VM and container orchestration layers for this kind of thing, I

More ›