daxfohl

14 ms·

181.
by daxfohl 9mo ago
These all jibe with my 25 years of experience (only one at google though). I'll add: * Don't work "off the clock", no matter how strong the urge: There's nothing managers hate more than surprises. Even good ones! If
182.
by daxfohl 10mo ago
Yes, this little-known blog post from 2015 with a similar line of thought was one of the most influential of my career: https://tomasp.net/blog/2015/library-frameworks/ The modern variant of this is "pla
183.
by daxfohl 10mo ago
I like this take. It seems like it would be useful to require professors to sit in on the class too. It'd be interesting to hear lots of different perspectives, ideas, concerns, etc., rather than a lecture format to half-awake students
184.
by daxfohl 10mo ago
For your task, instead of a direct translation, try adding a "distillation" step in between. Have it take the raw format and distill the important parts to yaml or whatever, then take the distillation and translate that into the n
185.
by daxfohl 10mo ago
Though remember that it's not a human. It's easy to waste a lot of time convincing it to do something in a certain way, then one prompt later it forgets everything you said and reverts back to its previous behavior. (Yes humans ca
186.
by daxfohl 10mo ago
Go slowly. Shoot for a 10% efficiency improvement, not 10x. Go through things as thoroughly as if writing by hand, and don't sacrifice quality for speed. Be aware of when it's confidently taking you down a convoluted path and conf
187.
by daxfohl 10mo ago
Yeah, I've seen (okay, and been responsible for) a lot of "the road to hell is paved with good intentions" due to jumping to some pattern or other because, well, it feels like the right thing to do. It makes the code cleane
188.
by daxfohl 10mo ago
Especially if we're approaching a plateau, in a couple years there could be a dozen equally capable systems. It'll be interesting to see what the differentiators turn out to be.
189.
by daxfohl 11mo ago
IME a dedicated testing / QA agent sounds nice but doesn't work, for same reasons as AI / human interaction. The more you try to diverge from the original dev agent's approach, the less and less chance there is that the
190.
by daxfohl 11mo ago
Yeah if anything I'd say people imagine things to be worse than they were. At least in the American education system, there's Rome, then 1000 years of plagues and misery, then the Renaissance. I was shocked the first time I went t
191.
by daxfohl 11mo ago
I'd say it's more "cost reduction" overall. And it makes sense to me. From my experience over the last few years, features are increasingly lower marginal ROI, and seem to take longer and longer to launch because the amo
192.
by daxfohl 11mo ago
So basically we need a JIT compiler for LLMs.
193.
by daxfohl 11mo ago
What happens when you separate the client and the server into their own LLMs? Because obviously we need another JS framework.
194.
by daxfohl 11mo ago
"What hardware giveth, software taketh away." IOW this is exactly how things will work once we get that array of nuclear powered GPU datacenters.
195.
by daxfohl 1y ago
Downdetector says aws and gcp are down too. Might be in for a fun day.
196.
by daxfohl 1y ago
It doesn't have to be much, or intentional, or even good for that matter. My kids practice piano because they don't want to let their teacher down. (Well, one does. The other is made to practice because WE don't want to let t
197.
by daxfohl 1y ago
It also partitions jobs into physical and intellectual aspects alone. Lots of jobs have a huge emotional/relational/empathetic components too. A teacher could get by being purely intellectual, but the really great ones have motiva
198.
by daxfohl 1y ago
It's easy: we have reached AGI when there are zero jobs left. Or at least non manual labor jobs. If there is a single non-physical job left, then that means that person must be doing something that AI can't, so by definition, it&#
199.
by daxfohl 1y ago
Oops you're right! I read these both yesterday and they blended together in my memory by the time I made this comment this morning. I knew something felt "off". Tangentially I'll have to reconsider my position on long bu
200.
by daxfohl 1y ago
Something still feels off if the formal proof can't be understood. I don't dispute its correctness, but there's a big jump from 4 color theorem, where at least mathematicians understood the program, to this, where GPT did the
201.
by daxfohl 1y ago
I remember someone (G.H. Hardy?) saying something along the lines of "the only bad thing about math is that it can be useful."
202.
by daxfohl 1y ago
Oh, by "real world" I meant "chains of thought generated by existing reasoning LLMs" (as opposed to injecting predefined CoT like was done in the experiment), not human thoughts.
203.
by daxfohl 1y ago
I wonder if append-only will continue to be important. As agents get more powers, their actions will likely be the bottleneck, not the LLM itself. And at n*2, recomputing a whole new context might not take much longer than just computing th
204.
by daxfohl 1y ago
I think there's some benefit of hindsight in that perspective though. I can imagine how, at the time, you see the advancement, and it's not obvious what the barriers for AI takeover are. Similar to software now, plenty of SWEs hav
205.
by daxfohl 1y ago
True. Generally it seems like you're visualizing things, moving stuff around, seeing vague patterns and trying to make them more clear. IDK how a transformer architecture would fit all of that in its context, or use it productivity onc
206.
by daxfohl 1y ago
Hmm, I wonder what happens if you let them manipulate their own context symbolically, maybe something like a stack machine. Perhaps all you need is a "delete" token, or a "replace" flag. That way you don't have cont
207.
by daxfohl 1y ago
The chains-of-thought here are artificially constructed, very information-dense partial sums formatted in a specific way that guides the fine tuning. A potential next step would be to look at real-world chains-of-thought and see whether som
208.
by daxfohl 1y ago
Assuming you mean cloud platforms in general, I don't even think it's that tangential. In fact it may cut to the heart of the matter: if React-over-REST-over-SQL-plus-some-background-jobs was all we needed, cloud platform innovati
209.
by daxfohl 1y ago
To me, the key quote is the simple "If you had told me in late 2022 I’d be saying these things 3 years later, I would’ve been pretty surprised." As someone with little exposure to the design industry, seeing how quickly AI could g
210.
by daxfohl 1y ago
Or by watching rats solve mazes

More ›