If I were you I would measure reconstruction errors from transformer predictions using input from the source document and then difference vs the target document

If I were you I would measure reconstruction errors from transformer predictions using input from the source document and then difference vs the target documents. The challenge would be to get a good measure of the difference, perhaps us some cosine difference again from the transformer? If you have specialist vocab you can train the transformers - so maybe you are doing legal matching?