4 ms·
I wonder if it would be possible to rate the code used during the training phase. For example the code could go through various static analysis tools and the re
by laurent_du 3y ago
I wonder if it would be possible to rate the code used during the training phase. For example the code could go through various static analysis tools and the result would be assigned as metadata to the code being used to train the model. The final model would then know that a given pattern is flagged as problematic by some tool and could take this into account not just to suggest new snippets but also to suggest improvements of existing snippets. Though I suppose if it was that easy, they'd have done it already.
- jasfi 3y agoThis is probably the next step for the LLM providers. They need to find ways to increase quality, and for code, there are many options. Perhaps code repos could get in on this too.
- progval 3y agoWouldn't this train it to avoid detection more than to avoid bad patterns?
- ivancho 3y agoYes, but presumably in the training data those two are quite correlated.