3 ms·
You've brought up good point. But let's consider this: Current LLMs are capable of generating code that rivals human output. However, two major challenges persi
by AIReach 3y ago
You've brought up good point. But let's consider this: Current LLMs are capable of generating code that rivals human output. However, two major challenges persist. First, there's no infallible method to evaluate the "quality" of code produced by LLMs. Second, even if LLMs were to submit pull requests, their generated code might not always meet our trust threshold for being "good enough."
Perhaps we should reframe the issue by focusing on developing LLMs that can precisely assess whether a PR should be approved. This approach simplifies the process to:
1. Instruct the LLM to modify a codebase.
2. Have the LLM generate a PR.
3. Leverage the LLM's ability to accurately determine PR quality for approval. If it's not good enough, the process returns to step 2.
So, to put it simply, if there comes a time when LLMs can match or even exceed human judgment in deciding whether to approve or reject a PR, it probably means we've reached a stage where LLMs can (or have) replace programmers.