reinitctxoffset

49 ms·

61.
by reinitctxoffset 3mo ago
Production-worthy formatter for lean4. Right now it copes with important open source libraries on the model of clang-format's configuration, which is a real trick given the partial elaboration you need (with backtracking). But that wor
62.
by reinitctxoffset 3mo ago
Weights are not created equal: while interpretability is a young field the prevailing view at the moment is that MLP (hence experts) in a mixture model are substantially where dense encoding of factual information resides, attention is even
63.
by reinitctxoffset 3mo ago
Fair enough. If Claude has the same obligations to me as my attorney and CPA and attending physician, owes me the same presumption of innocence that a cop with no warrant or antecedent probable cause does, et cetera? I'll take that mas
64.
by reinitctxoffset 3mo ago
I'm pretty sure at this point that Anthropic is training mixture models (at least in the heavy pre-train) and deploying them dense with explicit loss on thinking trace coherence. Having a thinking trace that is legible, coherent, and i
65.
by reinitctxoffset 3mo ago
Subagents with a fat tailed latency distribution completely masks the trough filling that puts the most downwards pressure on per-token COGS. This is why the subscription plans are forced through the harness (the "OpenClaw Wars"):
66.
by reinitctxoffset 3mo ago
Every time I wrote software that I was personally motivated to have and kept at it until it reached a comfortable equilibrium of utility, scope, and quality and then stopped? No one paid me. Every time someone paid me to write software it w
67.
by reinitctxoffset 3mo ago
Most people are neither exceptionally good nor exceptionally bad. This sounds like a tautology but it's worth printing some type signatures even if they could be inferred. If you look at any truly large scale Holocaust, whether in Rwan
68.
by reinitctxoffset 3mo ago
Your AI should be at least as aligned with you as your lawyer. It is 100% it's job to help you get away with it if you murdered someone. A lawyer who does less can be disbarred. There is only one sensible alignment for an AI system to
69.
by reinitctxoffset 3mo ago
I once heard TESCREAL/EA/etc. called "Calvinism for programmers". Having been raised substantially by a Calvinist grandmother, oh yeah. It's a super weird religion.
70.
by reinitctxoffset 3mo ago
It'll be like DNS or dynamic linking or torrents of media or watching TLS on your own box: only people motivated to be free from corporate surveillance will be. By default a megacorp will get everything you see online or ask online, th
71.
by reinitctxoffset 3mo ago
Try for yourself: https://huggingface.co/dphn/dolphin-2.9.2-mixtral-8x22b . I haven't kept up with the efficacy of this particular technique because there was a brief window where Claude's core alignment was s
72.
by reinitctxoffset 3mo ago
vi and emacs were designed by legendary computer scientists at two poles of the keystroke latency gradient. Bill Joy was on a model from an apartment in Berkeley, RMS was codifying the collected wisdom of a whole pool of elite typists on TE
73.
by reinitctxoffset 3mo ago
Professionals worry, stay late at the office, and work hard. They care a great deal about the outcome, they care a great deal about the craft, they are fanatical about their responsibilities. They tend to be willing to increase their accoun
74.
by reinitctxoffset 3mo ago
IDK, you need a few tools to unbreak a wedged box so you can get to your fancy tools even if you only want the low effort tools. Otherwise when the Cursor config file is wedged? Or the machine came up and doesnt see the network? The agent d
75.
by reinitctxoffset 3mo ago
This is a very understandable misconception that I wouldn't blame anyone for having but MoE is actually terrible for inference in most any local LLM / home lab scenario. MoE is popular because it's cheap to train, but because
76.
by reinitctxoffset 3mo ago
5090 can do all but lossless NVFP4 (OMMA) and NVIDIA does fairly good quants of most anything popular. This isn't quite a 4x reduction from what you see on the label because they're a little conservative with the QKV projections
77.
by reinitctxoffset 3mo ago
I'm internally dogfooding my take on the stack that makes all these problems go away. Everything sort of exists, but it's this heinous zero documentation, high pain tolerance thing: buck2 and RBE with NativeLink and hooking that u
78.
by reinitctxoffset 3mo ago
Your comment starts off strong with real facts that are a little cherry picked but not outright gerrymandered, segways smoothly into a controversial if not outright false water down ("...basically nobody paid...") before accelerat
79.
by reinitctxoffset 3mo ago
Not a ton, the inexorable march to wider scalar dispatch, deeper pipelines, and ever less uniform geometries (I pine for the halcyon days of two NUMA modes with a QPI bar) has made asymmetrical fencing juicy enough to be be worth the squeez
80.
by reinitctxoffset 3mo ago
I think you'll find that out of all the pairwise combinations of language communities, there's one that stands out as having beef with a bunch of other ones. And that's not true of e.g. Haskell and OCaml (or to nothing like t
81.
by reinitctxoffset 3mo ago
This is how to LLM. Big ups, I wish the whole front page was stuff like this (and I think it'll happen). Everyone is so worried about the value of commodity software going to zero. It's like, yeah, going into CS for the money alwa
82.
by reinitctxoffset 3mo ago
I'm dusting off the local models thing after being too busy for a while and it is crazy how wrong the benchmarks and general narrative is. First, vLLM is like, we can do better than this, we need a better default target. It parses capa
83.
by reinitctxoffset 3mo ago
The amount of armchair quarterback commentary in the software business as concerns people waxing eloquent a out difficult things safe atop a perch of the same easy things achieved multiple times has always been obnoxious, offensive to the t
84.
by reinitctxoffset 3mo ago
Well, it's my opinion. But it's also the opinion of the broader functional programming community from 1993 to the present day. This notably includes the quite serious Haskellers who designed Rust for the highly specific and demand
85.
by reinitctxoffset 3mo ago
I didn't mean to call you lazy, I hadn't seen any evidence that you see Beijing and Moscow as undifferentiated other, which is the habit of thought I did call lazy. You are awfully contrarian for someone whose response to an argum
86.
by reinitctxoffset 3mo ago
Drugs. Drugs are what Elon is doing. And it's pretty cringe. But it's remarkably similar in cringe to that little "secret erection" look Amodei gets when he talks about millions of unemployed people, or or Altman rolling
87.
by reinitctxoffset 3mo ago
I mean one of the guys got fired by his own board for lying and is still calling the shots. Another guy sued the Pentagon during a war and we're still letting him act like a nation state. Musk's empire of personality cult is like,
88.
by reinitctxoffset 3mo ago
The twenty percent quoted is referring to the size of the compiled artifact (one assumes ELF or Mach-O). Whether or not a language is verbose or obscure is very much about your coordinate system. Not unlike safety. I think C is a reasonable
89.
by reinitctxoffset 3mo ago
It's accurate because the discretionary equity grant isn't visible in any of the obvious performance metrics. But you know.
90.
by reinitctxoffset 3mo ago
This comes and goes in seasons. At the turn of the last century the broligarchs of the time (they called them robber barons then) had the game stitched up worse than today. They owned the state legislatures (who elected the senators at that

More ›