If you're explicitly looking to calculate document similarity via cosine distance, you may also want to try a technique that explicitly tries to map into an ort

If you're explicitly looking to calculate document similarity via cosine distance, you may also want to try a technique that explicitly tries to map into an orthogonal space, like any of the principal components analysis variants.