3 ms·
This is because AI-generated code will always be mediocre. There is so much poor-quality code in the training base that it will dilute the high-quality sources.
by smartmic 1y ago
This is because AI-generated code will always be mediocre. There is so much poor-quality code in the training base that it will dilute the high-quality sources. AI is not a craftsman who builds on his own high standards, but rather a token grinder tool calibrated to your prompts. Even if you describe your problem (prompt) to a high standard, there is no way it can deliver a solution of the same standard. This will be true in 2025 as it was in 2023 and probably always will be.
- wobfan 1y ago100%. Generative AI is and will always be trained on more or less all open source code that is out there, and by definition, from the training data, it will create a mix of this, which will statistically be mediocre. Which is fine, as long as people are aware of it.
- simonw 1y agoI just don't think that's true. The LLM vendors are all competing on how well their models can write code, and the way they're doing that is to refine their training data - they constantly find new ways to remove poor quality code from the training data and increase the volume of high quality code. One way they do this is by using code that passes automated tests. That's a unique characteristic of code - you can't do that for regular prose, or legal analysis or whatever. "Even if you describe your problem (prompt) to a high standard, there is no way it can deliver a solution of the same standard." My own experience doesn't match that. I can describe my problems to a good LLM and get back code that I would have been proud to have written myself.