ElFitz

8 ms·

91.
by ElFitz 4mo ago
In "Language Models are Unsupervised Multitask Learners"[0]. Not sure whether it’s "the" GPT-2 paper. 3.7 Translation > Performance on this task was surprising to us, since we deliberately removed non-English webpages
92.
by ElFitz 4mo ago
> LLMs can only reconstitute things in its training data Such as a 4D raytracing engine in Metal? Or integrating APIs for features first released months after their knowledge cut-off date? LLMs have shown an ability to transfer "kno
93.
by ElFitz 4mo ago
I still remember learning about habeas corpus. And loved Terry Pratchett’s take on it.
94.
by ElFitz 4mo ago
Some people even had some fun de-minifying JS and disassembling binaries. Successfully.
95.
by ElFitz 4mo ago
First one was Stable Diffusion. Especially the image to image, and the first gos people had at making videos with it. Second one was trying to bootstrap what would come to be called a "harness", back in 2023, initially serving as
96.
by ElFitz 4mo ago
Agreed. Some have even trained neural networks made of actual biological neurons to play doom[0]. Brain cells! Doing smart things! I still wouldn’t argue that this brain in a Petri dish is, in any way, conscious. Despite it sharing the exac
97.
by ElFitz 4mo ago
How are decompiling code or making a design system inspired by another one even remotely illegal?
98.
by ElFitz 4mo ago
The first thing that came to mind reading it was "backtracking". Which I guess is the recursive pathfinder piece?
99.
by ElFitz 4mo ago
That is fascinating. Thanks!
100.
by ElFitz 4mo ago
I’d gladly take a few of these self-contained rack-clusters off their hands when they do. I’d even get a house with a garage or something just for that.
101.
by ElFitz 4mo ago
> Placement is probably the big issue that needs to be solved now. Would some sort of constraint-solving algorithm help with that? Something like (but not necessarily) Cassowary[0]? Maybe I'm misunderstanding what is meant by placem
102.
by ElFitz 4mo ago
And are exposed as local files stored in documented, stable, and sane paths. Their sync is good too, in my limited experience.
103.
by ElFitz 4mo ago
Isn’t that the usual EU startup playbook once they give up on the B2C or world-scale SaaS markets? Refocusing on large (European) enterprise B2B and government contracts? It always felt to me this (enterprise B2B) was where European startup
104.
by ElFitz 4mo ago
> tiny <2-3B -- could run in a browser even, mac neo Or a phone. I’m running Gemma 4 E2B in one of my apps on my 14 pro (which may or may not be killing my display through overheating. It might just be a coincidence).
105.
by ElFitz 4mo ago
I never considered the implications and impacts on datacenters' architecture and organisation. It’s fascinating.
106.
by ElFitz 4mo ago
Over here our CTO replaced Intercom with an internal equivalent that costs less than $20 / month to run, haiku and sonnet support agent costs included. In less than a few weeks, in his spare time.
107.
by ElFitz 4mo ago
I recently switched from GitHub Actions to Buildkite + self-hosted runners. Setting it all up would have been tediously annoying eight months ago (Buildkite requires setting up GitHub webhooks for each repo). Last week I just had codex set
108.
by ElFitz 5mo ago
Another aspect is that selling to all of Europe as a B2C business is hard. Until recently you ended up having to register for VAT all over the place, god only knows how many different specificities, bureaus, and rules, with most payment sol
109.
by ElFitz 5mo ago
> Why TF haven't enterprise made it more painful for these events? They mostly have. By mostly refraining from dealing with startups and companies they deem either “too young” or "too small" to be reliable partners. And, w
110.
by ElFitz 5mo ago
I looked at Punkt. They keep saying "If you don’t pay for the product, you are the product". Okay, all fine and well. But what will my phone still actually be able to do if / when I stop my subscription? Not a single clear an
111.
by ElFitz 5mo ago
The risk is people who incidentally get into software engineering through using agents probably won’t be aware of any of that. And probably wouldn’t care even if they did. And for most software they’ll create, single user, perhaps even sing
112.
by ElFitz 5mo ago
A punchcard with extra steps? Enlighten us.
113.
by ElFitz 5mo ago
Instead we’ll all run LLMs that generate UI from scratch, at run time, using up gigabytes of RAM and who knows how much power on every request and response. Progress! (I’m half kidding)
114.
by ElFitz 5mo ago
> Something is lost along the way. Definitely. My point is more that it seems to have been the way of the world for the past few decades. I’m arguing it’s nothing new, basically a trope at this point. And once that is said, if we care ab
115.
by ElFitz 5mo ago
There will always be dataset and training quirks, and the provider’s own biases and focus, granting one model an edge over the others in some specific domain.
116.
by ElFitz 5mo ago
I am afraid we just aren’t going to be able to understand each other.
117.
by ElFitz 5mo ago
No, current models and tools are more than capable of dissecting entire codebases. And even if they somehow weren’t, we’d just do what we used to do with documents to turn them into "chewable bites": chunking, extracting, summaris
118.
by ElFitz 5mo ago
I thought so too. But 1) people use other models with that same harness. 2) I moved on from Claude Code and all the features I cared for up and running in less than a couple days. Without even looking for available plugins or extensions.
119.
by ElFitz 5mo ago
> The only genuine moat the frontier labs have is their product take-up And even then, their is no stickiness. For most use cases there isn’t much value in one frontier model over the other. Just have to look at the people flocking from
120.
by ElFitz 5mo ago
> Shitty will be the new normal. I’ve heard the same from the best devs, and some who thought themselves to be the best, I’ve known long before LLMs were ever a thing. I’m sure others heard the same when JavaScript and Python became near

More ›