3 ms·
What is the point collecting this data? I feel like this is like "A list of N,NNN repositories using IDE(s)" Hmmm I don't get it?
by prologic 20d ago
What is the point collecting this data? I feel like this is like "A list of N,NNN repositories using IDE(s)" Hmmm I don't get it?
- naruhodo 20d agoSo that this list can be added to the list of lists.
- tay1or 20d agoyou got me, this is the real point of the list
- tay1or 20d agoThe data was collected for a paper that was attempting to find a lexical difference between human contributions and LLM contributions. The reason for this was because repository maintainers need to make sure submitted code has been at least reviewed by a human. By detecting unattributed AI submissions, it can tell maintainers that they need to pay extra attention to the repositories.
- prologic 20d agoAnd does that work? Can you genuinely tell whether a human has reviewed Ai-assisted/generated code?
- tay1or 20d agoYou can't tell if a human has reviewed AI-assisted / generated code. But you can tell if an AI wrote a comment or commit message. The evaluation section of the paper goes over in-depth the findings: https://github.com/ActuallyTaylor/strata/blob/main/paper/Taylor%20Lineman%20-%20Changes%20in%20Vocabulary%20Between%20Human-created%20and%20LLM-assisted%20Code%20Repositories.pdf https://github.com/ActuallyTaylor/strata/blob/main/paper/Tay...