Kudos to analyzing the data! I wonder how the duplicate file detection was implemented. Was it just take a hash of the file contents and see if the hash alread

Kudos to analyzing the data! I wonder how the duplicate file detection was implemented. Was it just take a hash of the file contents and see if the hash already exist? Was it compare the file name? I imagine that many duplicates may exist that contain one file written in one editor and then loaded to another editor, auto formatted (to convert spaces to tabs or vice versa) and then pushed back up. So you might have two files with identical code but different whitespaces. I also wonder (for Javascript) if the minification steps screws up the results too, since minifiers may convert tabs to spaces or vice versa... Anyway, I'm probably overthinking this. Great job!