benreesman

16 ms·

61.
by benreesman 1y ago
Ryzen AI 9 395+ with 64MB of LPDDR5 is 1500 new in a ton of factors and 2k with 128. If I have 1500 for a unified memory inference machine I'm probably not getting a Mac. It's not a bad choice per se, llama.cpp supports that harwa
62.
by benreesman 1y ago
If Moore's Law is Ending leaks are to be believed, there are going to be 24GB GDDR7 5080 Super and maybe even 5070 Super Ti variants in the 1k (MSRP) range and one assumes fast Blackwell NVFP4 Tensor Cores. Depends on what you're
63.
by benreesman 1y ago
Well I blame our legislators, our regulators, and a public who tolerates low integrity, low competence leadership. A society gets what it pays for with the standards it sets for its leaders. Out of a great many outcomes a very topical one t
64.
by benreesman 1y ago
Nah, their people are way involved in mdarray and ROCm is looking to have the "oh no its broken again" bit flipped off in the RDNA 4/5 cycle. NVIDIA wants Python and C++ people, they want a new thing to moat up on, and they k
65.
by benreesman 1y ago
I'm in kind of a different place with it on the inference side. I've got these crazy tuned up CUDA kernels that are relatively straightforward to build in isolation and really where all the magic happens, and there's this new
66.
by benreesman 1y ago
Right a broader theme about AI safety and AI politics and all of it: we have choices as a society, so if our choices are good and our will to see those choices respected are intact, then the scope for harm is pretty manageable. When the one
67.
by benreesman 1y ago
I'm not saying that the decline of Enlightenment values and the rise of crony-nepo-central-committee surveilance nightmare is "other", I'm saying it is indifferent to the stated political system, it's about the de f
68.
by benreesman 1y ago
There isn't an "authoritarian bit", it's not binary. When I was young the idea that your own computer would spy on you, or the one in your phone, or in your car? That was a William Gibson novel, wiretaps happened to mob
69.
by benreesman 1y ago
Human nature admits a spectrum of outcomes on this, and I'd argue that most humans are not in fact pathologically acquisitive and power obsessed. Most humans value high status , but healthy societies confer high status in ways de-coup
70.
by benreesman 1y ago
In 2025 if you need convenience and no red tape you've got fly.io in the general case and maybe Vercel or something on a particular framework (there are some good ones for a particular stack). If your needs go beyond that? Then you nee
71.
by benreesman 1y ago
I appreciate that hitting sm_70 through sm_120 in one call isn't the same as hitting RISC-V in one call, but I do a lot of builds just for sm_120 which is closer to a fair comparison. It's imperfect, but I take any excuse to point
72.
by benreesman 1y ago
I was agreeing with GP I just didn't annotate my Archer reference well. My bad.
73.
by benreesman 1y ago
ptxas comes to mind.
74.
by benreesman 1y ago
Nice work and good writeup. I think most of that is very sound practice. The codegen switch with the offsets is in everything, first time I saw it was in the Rhino JS bytecode compiler in maybe 2006, written it a dozen times since. Still cl
75.
by benreesman 1y ago
Do you want a dysfunctional soviet central party planning committee? Because this is how you get a late Soviet central committee.
76.
by benreesman 1y ago
Take it up with the people who could easily prevent it by instituting reforms, not with me, that's shooting the messenger because I'm easier to get to. But I'm fighting those people tooth and nail precisely because every smal
77.
by benreesman 1y ago
It comes and goes in seasons. There is always a tension between the needs of the many and the pathological acquisitiveness of the few, but this is the worst in the West in living memory. The last remotely compatible situation was the late U
78.
by benreesman 1y ago
My observation is that Opus is chronically capacity constrained while being dramatically more expensive than any of the others. To me that more or less settles both "which one is best" and "is it subsidized". Can't
79.
by benreesman 1y ago
I think much like coding, the top of the game is all the old stuff and a bunch of new stuff that is impossible to master without some real math or at least outlier mathematical intuition. The old top of the game is available to more peopl
80.
by benreesman 1y ago
This holds in other areas as well, and to me at least the conclusion follows from the evidence: there is seemingly a lot of potential in agent coding, a few tasks are just crushed/solved (quick webapp demos, other library stitching i
81.
by benreesman 1y ago
Haskell makes guarantees. Modern C++ makes predictions to within a quantifiable epsilon. Rust makes false promises in practical situations. It invented a notion of safety that is neither well posed, nor particularly useful, nor compatible w
82.
by benreesman 1y ago
If you mean running clang-tidy as a separate build step or ASAN in a different category than other soundness checks? Compute is getting tight, lots of trends, the age of C++ is winding down gracefully. The age of Zig is emerging delibetatel
83.
by benreesman 1y ago
It's just a different convention like radians and degrees. You can lift/unlift in or out of arbitrary IO, in some languages one direction is called a mock, in other languages the opposite is called unsafeFoo. Andrew Kelley indepen
84.
by benreesman 1y ago
There's nothing inherently wrong with containers in the abstract: virtualization is a critical tool in computer science (some might it's difficult to define computer science without a virtual machine). There's not even anythi
85.
by benreesman 1y ago
I'm on record as pretty stridently anti-AI Hype Bullshit (I was calling Altman a criminal back when that had real-world consequences, check the history). But this is in the vanishing minority of frontpage AI threads where it's a r
86.
by benreesman 1y ago
ASUD ProArt P16. I never want another machine. Slender, stiff, machined out of something expensive feeling. Everything works on 6.16, 4k OLED display, wonderful keyboard. Solid RDNA unit, NVIDIA card alongside. With a clean hyprland setup,
87.
by benreesman 1y ago
TLDR: Broken builds are the default in everything, only exceptional effort and resources get you anything else, in Python, the people with those resources have unclear incentives for anything to improve. I think it's a combination of h
88.
by benreesman 1y ago
I usually think the same way, and I bet a lot of people do which is why its still broken. But I've finally decided it's never going away completely and it's time to just fix it.
89.
DMCA Used to Take Down GamersNexus Nvidia Smuggling Expose(twitter.com)
20 points by benreesman 1y ago|1 comments
90.
by benreesman 1y ago
I agree with you that binary distribution is a perfectly reasonable adjunct to source distribution and sometimes even the more sensible one (toolchain size, etc). In this instance the build is way nastier than building the NVIDIA toolchain

More ›