4 ms·
> Where I suspect LLM output won’t help much. [...] Low level infrastructure code the kind I’ve spent my whole life on That's just wishful thinking. First, th
by jsnell 1y ago
> Where I suspect LLM output won’t help much. [...] Low level infrastructure code the kind I’ve spent my whole life on
That's just wishful thinking.
First, that kind of code is one of the things that's most valuable for AI to get good on, so a lot of effort will be directed to that. More efficient low level systems help with recursive self-improvement. Writing JS frontends doesn't.
Second, systems programming is a domain with objective quality metrics that makes it a good RL target.
Third, the models are already very good in that domain. They obviously don't have perfect taste yet, so having an experienced systems programmer with a vision guiding the model will be much better than fire and forget.
When implementing a new optimisation is 10% the cost that it used to be when done manually, the tradeoff for which ones are worth implementing changes.
But in addition it's way easier to justify exploration and speculative ideas when they're so cheap to test out.