3 ms·
> A 500k line codebase for an agent CLI proves one thing: making a probabilistic LLM behave deterministically is a massive state-management nightmare. Consider
by p-e-w 7mo ago
> A 500k line codebase for an agent CLI proves one thing: making a probabilistic LLM behave deterministically is a massive state-management nightmare.
Considering what the entire system ends up being capable of, 500k lines is about 0.001% of what I would have expected something like that to require 10 years ago.
You can combine that with all the training and inference code, and at the end of the day, a system that literally writes code ends up being smaller than the LibreOffice codebase.
It boggles the mind, really.
- sarchertech 7mo ago> You can combine that with all the training and inference code, and at the end of the day, a system that literally writes code ends up being smaller than the LibreOffice codebase. You really need to compare it to the model weights though. That’s the “code”.
- pixl97 7mo ago>You really need to compare it to the model weights though Then you'd need to compare the education of any developer in relation to how many LOC their IDE is. That's the "code". So yea, the analogy doesn't make a whole lot of sense.
- deleted 7mo ago[deleted]
- raincole 7mo ago... what are you even talking about? "The system that literally writes code" has a few hundreds of trillions of parameters. How is this smaller than LibreOffice? I know xkcd 1053, but come on.
- davidkunz 7mo agoOh, you should have a look at Pi then. https://github.com/badlogic/pi-mono/tree/main/packages/coding-agent https://github.com/badlogic/pi-mono/tree/main/packages/codin...
- oblio 7mo agoIt even wrote an entire browser! By "just" wrapping a browser engine.