I have experimented using LSH (Locality Sensitive Hashing) for identifying similar documents, among 50k documents in total. My LSH implementation is here: http

I have experimented using LSH (Locality Sensitive Hashing) for identifying similar documents, among 50k documents in total. My LSH implementation is here: https://github.com/loda-lang/loda-rust/blob/develop/script/task_instruction_similarity_lsh.rb https://github.com/loda-lang/loda-rust/blob/develop/script/t... Example of the 100 most similar documents: https://github.com/neoneye/loda-identify-similar-programs/blob/main/oeis/014/A014017_similarity_lsh.csv https://github.com/neoneye/loda-identify-similar-programs/bl... There can be false positives, so after LSH then do a more in-depth comparison.