hadlock

4 ms·

31.
by hadlock 1mo ago
It might be time to take a sabbatical
32.
by hadlock 1mo ago
The "original" XTEINK X4 (not pro) has a USB-C port - that's explicitly why I bought it. It looks like it is out of production now. The good news is they are a proven, very popular device (it's just an e-ink display glue
33.
by hadlock 1mo ago
Right now qwen 3.6 35b-a3b has a success rate of 92% and qwen 3.8 27b has a success rate of 96%. But the 35b moe does about 1080 tokens/s at concurrency 54, vs 480 tokens/s at concurrency 28. For our specific workflow on blackwell
34.
by hadlock 1mo ago
I suspect we will see optimizations where the various vectors of the n-gram you actually use are hot in vram, the rest are warm in system memory and then cold storage on nvme. Same with MoE. If your workflow is particularly same-y then you&
35.
by hadlock 1mo ago
It means if your network is IPv6 native, you don't have to waste a very expensive IPv4 IP address, or proxy through one, to connect to it
36.
by hadlock 1mo ago
>I don't get the second brain thing. I don't keep a second brain, I just read and think a lot. Yes, but writing also helps you lens your thoughts in a completely different way. This is why so many people journal, or blog, or vl
37.
by hadlock 1mo ago
the important thing is that Qwen 3.7 27B will run unlimited jobs on my consumer grade laptop at 60 tokens/second for free, forever, in about 1-2 years
38.
by hadlock 1mo ago
set thinking to minimal and use these jinja templates: https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates we went from 62% completion to 92% using a claude code harness
39.
by hadlock 1mo ago
Most of the erosion is due to oil and gas companies dredging poorly thought out canals to move drilling equipment through the marsh, causing unslowed erosion for ~70+ years.
40.
by hadlock 1mo ago
The oil and gas companies brought in huge massive drilling rigs in the 1930s-1960s. The marsh was too soft/soggy to bring in the equipment overland, so they just... dredged huge canals in the soggy marsh a couple feet deep. You can see
41.
by hadlock 1mo ago
It turns out you can train a 1b model at almost 1000 tokens/s on a m5 max laptop. As a personal experiment, I've been asking Sol for synthetic training data and synthetic agentic training data (model distillation in it's pure
42.
by hadlock 1mo ago
Maybe it's just me, but between the extremely thin font and layout design, I find this extremely difficult to parse. Overuse and improper use of italics is confusing as well.
43.
by hadlock 1mo ago
I guess you haven't tried ratatui then. All my cli offer a ratatui dashboard mode, and about 50% of the dashboard mode end up as a status dashboard down the road
44.
by hadlock 1mo ago
MacOS: what is my purpose Me: you exist so I can launch iTerm2, Chrome, and VS Code MacOS: oh, my god I can't ever imagine using walled garden graphics api in 2026. Particularly for work tooling
45.
by hadlock 2mo ago
I suspect due to model distillation, their need to stay on top for IPO value is more important than absolutely crushing their competition, who will simply harvest their output and distill it for training data on a ~3 month delay. Also they
46.
by hadlock 2mo ago
When the market settles down, most of the money is going to be in bulk inference, for batch jobs. In 5 years everyone's laptop will be able to run Qwen 3.8 27B for coding tasks, but businesses will still need to run inference 24/7
47.
by hadlock 2mo ago
I was surprised when I went for an extended visit to Colombia - outside of beef cuts (an entire rack of ribs, bit butcher cuts, not a single steak or a dozen hamburger patties) frozen foods are virtually non-existant. If you wander into any
48.
by hadlock 2mo ago
OpenAI will have pretty good future free cash flow...until GDDR7 prices are no longer inflated by scarcity. Which could be 24-72 months.
49.
by hadlock 2mo ago
Prior to 1970? Almost all of them. Or enough to be statistically significant.
50.
by hadlock 2mo ago
>They don't perform as well as winter tires in the winter, and A lot of people don't live in climates where winter tires are even sold; particularly California, Texas, Florida, three of the most populous states. Many people in
51.
by hadlock 2mo ago
Two of my cars wear specialty tires, one is a citroen that uses specialty Michelin Pilot-X tires designed exclusively for Citroen (and a handful of Renault) of that era, the other wears very limited production tires designed to go on spoke
52.
by hadlock 2mo ago
>Register is not a serious publication Do you have a source to back this up? The register has been covering IT since before most people here were born, and literally invented BOFH.
53.
by hadlock 2mo ago
NIN and iD (re-?)released a vinyl record set for the 30th anniversary a couple weeks ago.
54.
by hadlock 2mo ago
I benched Qwen 3.6 35B-A3B against Qwen 3.8 27B with the same parameters, thinking set to low. Despite 35B having 9x fewer active parameters, it benched only 2.34x slower. The 35B got only 50% more agentic tasks done per hour.
55.
by hadlock 2mo ago
Strangely Qwen 3.8 Max isn't on their list, at all.
56.
by hadlock 2mo ago
I didn't have time to run this as well, but we're getting a 99% agent completion rate across all tasks and 98% task decision that matches the human selected option(s) on Qwen 3.8 27B @ NVFP4. There may be a difference between FP8
57.
by hadlock 2mo ago
Thanks this bumped my agent success rate from 67% to 92.5% (!!!)
58.
by hadlock 2mo ago
Turning off thinking mode you need a different tokenizer and a whole host of settings. It's more like switching your vehicle from gas to diesel, than turning your headlights from lo to hi.
59.
by hadlock 2mo ago
For high concurrency, using the blackwell's native native W4A4 MLP compute path, nvfp4 is something like a 1.2-1.5x performance increase over FP8. We're doing data enrichment (so, tasks completed successfully + tokens/second)
60.
by hadlock 2mo ago
This is the version we'll be testing on our rtx 6000 today! Thank you

More ›