bjackman

5 ms·

31.
by bjackman 2mo ago
It is not a competitor to those it competes with Sonnet. Google's Opus competitor is 3.1 Pro Preview which is essentially obsolete (competed with Opus 4.6). They do not have a Fable/Sol competitor.
32.
by bjackman 2mo ago
> With that difference in training speed, it should be impossible for Chinese models to close the gap that easily. They have a big advantage in that they can directly distill from frontier models.
33.
by bjackman 2mo ago
I think ROCm is just a total second class citizen in the space TBH. It's a shame coz it's not even really what we want, we would obviously all be better served if we could use Vulkan or something. But I guess it's inevitable
34.
by bjackman 2mo ago
It's a unit of mass used in the firearms world
35.
by bjackman 2mo ago
I believe the fully baked-in nature is pretty important for the perf they get. With a cartridge port you now have a bus between the weights and the compute and the weights and that bus can become a bottleneck. So I think we're looking
36.
by bjackman 2mo ago
For anyone who wants to learn more about this claim, I thought this video was cool: https://youtu.be/M9Hoy9Kn1u0?is=1O5AJPEziihH1MSJ
37.
by bjackman 2mo ago
Dwarkesh recently pointed out [0] that these guys are almost forced to spend most of their compute on training instead of inference. This is because they need to maintain the appearance (which may also be the truth) that future models will
38.
by bjackman 2mo ago
No I think you are thinking of Etched/Sohu. Taalas' approach (at least for their demo'd product) is to bake the whole thing in completely. IIUC the optimiser can even see the weights while generating RTL. It's like there
39.
by bjackman 2mo ago
I'm not satisfied with any of the text editors I've used (I've used all the big ones for a few years each). Zed was a promising new direction I.e. VSCode minus the bullshit. But it's not getting the polish / product
40.
by bjackman 2mo ago
I don't want someone "to make it simpler for developers to follow changes applied by an LLM in an ergonomic fashion". I want a text editor. I want "VScode without the bullshit". That's what I thought they were
41.
by bjackman 2mo ago
this prompted me to search and find: https://addons.mozilla.org/en-US/firefox/addon/xcancel/
42.
by bjackman 2mo ago
ABP works for the most common of these too (e.g. popups/banners)! You have to enable it in the settings I think. JS annoyances it won't fix are like idiotic scrolling behaviour and stuff. And for that, yeah reader mode is ideal.
43.
by bjackman 2mo ago
Firefox has this too, it's useful. However I only find that I use it for websites that have shit CSS that makes it hard to read on mobile. For everything else AdBlock Plus works fine.
44.
by bjackman 2mo ago
You know if you tap on the text at the top, it takes you to an article that expands upon the question. In this case you'll find that article discusses the strengths and weaknesses of the materials bottleneck!
45.
by bjackman 2mo ago
In the Linux kernel I've had a lot of luck with: 1. "find the code that does X" 2. go read that code 3. When you hit a bit you don't care about, go back to the model and ask it for the pertinent details 4. When you hit a
46.
by bjackman 2mo ago
I have been pondering this and I think it's likely a gap that will get filled sooner or later. Right now there's just so much value in building LLM tools for experts that everyone is focusing on that. But surely at some point we&#
47.
by bjackman 2mo ago
> The model outputs are much more concise than when I try and talk to GPT-5.6 Sol about mathematics. By signalling expertise, Tao shunts the model into “talking-to-mathematicians” Maybe, but FWIW my first thought when I skimmed Tao'
48.
by bjackman 2mo ago
I think it was reasonable in the very recent past. There was a period where AI had major capabilities that had not diffused fully into the zeitgeist. So often you could see someone struggling with e.g. understanding a crash log, and say &qu
49.
by bjackman 2mo ago
It doesn't matter if you have the RAM, running a 1.5TB model for a single context stream is fundamentally inefficient.
50.
by bjackman 2mo ago
I agree but worth noting that it's never gonna be very practical to run LLMs like this at home. Unless we have some sort of design breakthrough, the only "sensible" way to run them is at high batch levels on shared HW. Like,
51.
by bjackman 3mo ago
> This is a very fast model. I was already impressed by how fast 3.5 Flash was. But I've never compared it to other models in its class for coding. Why? Coz models in that class are not very useful to me. Time saved waiting for resp
52.
by bjackman 3mo ago
Coz you want to know what flooring, doors, cupboards, bath, sinks, railings, windows, etc they are putting in. I went to view a flat this week, it was a building site. That's still the most important bit coz you get a feel for the size
53.
by bjackman 3mo ago
Requiring disclosure seems obvious. Using AI for these pics is also not inherently deceptive though. I live in an extremely overheated housing market where properties are usually sold/rented long before they actually get completed. I&#
54.
by bjackman 3mo ago
After a rebase, mybranch@{1} refers to the previous location of mybranch, so you don't need to manually track these before-rebase branches etc. (In practice I find this syntax super annoying and usually end up typing `git reflog mybran
55.
by bjackman 3mo ago
Google should be able to detect this and ban those apps from the Play Store. They have the incentive too.
56.
by bjackman 3mo ago
Even if nobody is "cheating" your particular definition of cheating, the benchmarks are _somewhere_ in the super-structural gradient descent. Models are benchmark-maximising machines at some level, so I think the benchmarks are in
57.
by bjackman 3mo ago
Great to see there are others doing the same. It's a extremely cool that ESPHome is able, just by existing and being good, to create this little industry of no-bullshit products. What an awesome project that is!
58.
by bjackman 3mo ago
Yeah I was thinking airtightness might be the difference. My flat seems to be bizarrely hermetic (when you turn on the kitchen extractor fan, it struggles if you don't have a window open somewhere). So maybe a few leaky cracks are enou
59.
by bjackman 3mo ago
That's interesting coz I found the opposite, at my place to keep the level below 1k I usually have to open a window in the room I'm in, or use a fan. I live on a noisy street so I don't usually want to do that, if I open a wi
60.
by bjackman 3mo ago
IMO it's something where an intervention is often cheap enough that it's worth it even without great evidence. But also bear in mind that regardless of "are we operating at max effectiveness", OSHA sets a legal limit of

More ›