2 ms·
>because LLMs lack reasoning abilities to determine if a fix is good You will at least need to build a feedback loop where it checks that 1) the code can actua
by vsareto 3y ago
>because LLMs lack reasoning abilities to determine if a fix is good
You will at least need to build a feedback loop where it checks that 1) the code can actually compile 2) all tests pass and 3) other code analyses passes. Ideally it shouldn't present a solution if it can't meet those criteria but that also adds a lot of lag time for suggestions when it may not be needed for simple suggestions.
What patterns it uses is up to training or examples or reinforcement learning. Good is human/team/company-subjective too (with some obvious hard requirements), so you will have to train specifically for your kind of quality.