You'll have to normalize them to text to make it work - the format is not important for the deduplication (meaning the same text in a word doc or pdf is really

You'll have to normalize them to text to make it work - the format is not important for the deduplication (meaning the same text in a word doc or pdf is really the same thing to you, even though at the byte level the files may be very different.)