4 ms·
These tools sound like a good idea, but then I try them and they always fall over at the same place: My problem isn't running the agents, I have an SSH terminal
by stavros 1y ago
These tools sound like a good idea, but then I try them and they always fall over at the same place: My problem isn't running the agents, I have an SSH terminal that supports tabs on my phone. My problem is QAing and reviewing the code all these agents write, and none of these tools solves that.
- JyB 1y agoAssuming you're using GitHub or similar, make pushing branches and creating PRs part of their prompts, and review on the GitHub app or equivalent? Seem like an orthogonal problem to those LLMs tools.
- stavros 1y agoI can review the code that way, but not the outputs. I could have it write tests and run them, but that's usually fiddly for web apps.
- johntash 1y agoIf it's a webapp, have the CI pipeline create a temporary env and deploy the branch to it?
- stavros 1y agoYeah, that's basically the only solution I can think of, but requires quite a bit of infra work. I guess that's what LLMs are for, huh...
- _1tem 1y agoCheckout the PRs to your local machine and test it there?
- stavros 1y agoThat kind of defeats the purpose of running the agents in the cloud, no?