4 ms·
As noted in another answer-- the data is very free form and a simple diff may not help. Imagine having a million resumes (some in doc, some in pdf, some in htm
by passioncurious 10y ago
As noted in another answer-- the data is very free form and a simple diff may not help.
Imagine having a million resumes (some in doc, some in pdf, some in html) and you want to dedupe them.
- pwg 10y agoWhich important detail also was not in the original question. What was in there was: I essentially want to store one variation of the content in my database, with references to altered variations of the content, but I need to be able to detect the altered data. For which a "diff" style algorithm is a possibility, just storing the "alterations". Your update edit changed your question to be one for a different problem. For this goal-post move, you'll want to look into plagiarism detection algorithms.
- passioncurious 10y agoThat's why I updated the question to prevent any more confusion. Thanks-- plagiarism detection sounds like a good avenue to check out.