We've reached a similar conclusion for refactoring. The first version of our product (https://grit.io https://grit.io) was entirely LLM-powered. It was very ea

We've reached a similar conclusion for refactoring. The first version of our product (https://grit.io https://grit.io) was entirely LLM-powered. It was very easy to get started with, but reliability was low on enterprise-scale codebases. Since then, we've switched to a similar approach: using LLMs to manipulate a verifiable interface, but making actual changes through deterministic code.