3 ms·
It would be nice if the tools we usually use for LLMs had a bit more programmability. In this example, It we could imagine being able to chunk up work by proces
by fwip 1y ago
It would be nice if the tools we usually use for LLMs had a bit more programmability. In this example, It we could imagine being able to chunk up work by processing a few items, then reverting to a previous saved LLM checkpoint of state, and repeating until the list is complete.
I imagine that the cost of saving & loading the current state must be prohibitively high for this to be a normal pattern, though.
- radarsat1 1y agoAgreed. You basically want an LLM to have a tool that writes its own agent to accomplish a repetitive task. I think this is doable.
- steveklabnik 1y agoYou can already sort of do this by asking it to write a script to do the refactor. Claude sometimes suggests this on its own to me even. But obviously sometimes larger refactors aren't easy to implement in bash.
- fwip 1y agoRight - and ideally, after writing the script to do the task, it could discard all the tokens involved in writing the script.