3 ms·
>Due to the prevalence of forking and copy-pasting within the codebase, nearly 75% of files are completely duplicated. This is surprisingly high. Does the incl
by smilebot 2y ago
>Due to the prevalence of forking and copy-pasting within the codebase, nearly
75% of files are completely duplicated.
This is surprisingly high. Does the include imported libraries and packages? Since you are hashing at the file level, I am not fully convinced that this is due to people copying entire files over without modification.
- deleted 2y ago[deleted]
- Kubuxu 2y agoProbably forks/duplicates of repos in the dataset.
- ebalit 2y agoAlso commits. I imagine that there is a lot of information to gather from the history of repos in addition to the "static view" of a codebase. However, it doesn't seem trivial to do deduplication in that case without removing relevant/necessary context.