4 ms·
I agree and disagree. You definitely need someone competent to take a look before merging in code, but you can do a first pass with an LLM to provide immediate
by rohansood15 2y ago
I agree and disagree. You definitely need someone competent to take a look before merging in code, but you can do a first pass with an LLM to provide immediate feedback on any obvious issues as defined in your internal engineering standards.
Especially helpful if you're a team with where there's a wide variance in competency/experience levels.
- aaomidi 2y agoUntil that immediate feedback is outright wrong feedback and now you’ve sent them down a goose chase.
- rohansood15 2y agoThis is where prompting and context is key - you need to keep the scope of the review limited and well-defined. And ideally, you want to validate the review with another LLM before passing it to the dev. Still won't be perfect, but you'll definitely get to a point where it's a net positive overall - especially with frontier models.
- throwthrowuknow 2y agoThat happens with human review too and often serves as an opportunity to clarify your reasoning to both the reviewer and yourself. If the code is easily misunderstood then you should take a second look at it and do something to make it easier to understand. Sometimes that process even turns up a problem that isn’t a bug now but could become one later when the code is modified by someone in the future.