4 ms·
Since no one knows or can agree on what "code quality" is and we can't measure it for human output, I'm dubious about measuring it for LLMs
by singpolyma3 4mo ago
Since no one knows or can agree on what "code quality" is and we can't measure it for human output, I'm dubious about measuring it for LLMs
- kube-system 4mo agoYou don't need universal consensus to measure something. There are many good quality measures of code quality.
- embedding-shape 4mo ago> There are many good quality measures of code quality. Besides the traditional and mechanical "less LOC", cyclomatic complexity and similar, which ones are you talking about exactly?
- kube-system 4mo agoI'm not talking about any specific measure. There are many. Pick some, and you have a benchmark.
- embedding-shape 4mo agoI understand you're talking about "many", could you give an concrete name or example of at least one?