3 ms·

It's interesting that you're moving from a "cloud/batch" approach based on GitHub issues and PRs to more of a "local/batch" approach. It seems that this new ver

It's interesting that you're moving from a "cloud/batch" approach based on GitHub issues and PRs to more of a "local/batch" approach. It seems that this new version of sweep still is sort of agentic and sends GPT off to iterate on a highly specified task until some pre-written tests pass? As a contrast, aider [0] has always been focused on a "local/interactive" ai coding model. It lets you "pair program" with GPT-4, within your existing git repo code base. You can give GPT fairly short, informal instructions and you see GPT's code edits stream back in real time. If you see that it has misunderstood, you can interrupt or undo the edit and offer more direction. This feels potentially more efficient than very carefully specifying the task up front, pre-writing the tests, firing off a long agentic job ... and then finding out 20 minutes later that your instructions weren't clear enough. Have you considered a more interactive approach?

kevinlu1248 3y ago
The new Sweep assistant is also interactive! You can request for a plan, approve the plan to have Sweep run through each of the proposed files to edit. We found that it was really difficult to iterate with an agent that only responds every 20 min.
CGamesPlay 3y ago
I am not sure. I pretty much stopped using aider, to switch to chatting with GPT-4 directly. I don’t yet have a great meta-framework for coding this way, but I think it’s more agentic than interactive. If I had to describe my current process, it would be to 1) brainstorm approaches 2) create a toy implementation 3) integrate solution into project. Each of these steps is interactive. For brainstorming, I’ll usually have it create the simplest implementation, check it by eye only, and if it’s on the right track I will begin adding constraints to make it more realistic. If it isn’t, throw away the conversation and start from a new prompt (don’t bother trying to get it to recognize its mistakes if they are categorical) Finally, if I’m feeling lazy, I will ask it to integrate this snippet into the real project (typically this is the first point GOT sees my actual code, and it’s just doing the mechanical transformation between the snippets). To automate the workflow that I’m talking about does require a more agentic approach than just a chat interface provides. I guess the answer is probably in the middle somewhere.

kevinlu1248 3y ago

The new Sweep assistant is also interactive! You can request for a plan, approve the plan to have Sweep run through each of the proposed files to edit. We found that it was really difficult to iterate with an agent that only responds every 20 min.

CGamesPlay 3y ago

I am not sure. I pretty much stopped using aider, to switch to chatting with GPT-4 directly. I don’t yet have a great meta-framework for coding this way, but I think it’s more agentic than interactive. If I had to describe my current process, it would be to 1) brainstorm approaches 2) create a toy implementation 3) integrate solution into project. Each of these steps is interactive. For brainstorming, I’ll usually have it create the simplest implementation, check it by eye only, and if it’s on the right track I will begin adding constraints to make it more realistic. If it isn’t, throw away the conversation and start from a new prompt (don’t bother trying to get it to recognize its mistakes if they are categorical) Finally, if I’m feeling lazy, I will ask it to integrate this snippet into the real project (typically this is the first point GOT sees my actual code, and it’s just doing the mechanical transformation between the snippets). To automate the workflow that I’m talking about does require a more agentic approach than just a chat interface provides. I guess the answer is probably in the middle somewhere.