We know that it's not just our modern language coloring our reading of it because Henry James's family wanted these passages removed from the published versions

We know that it's not just our modern language coloring our reading of it because Henry James's family wanted these passages removed from the published versions of the letters, precisely because they didn't want them to be 'misconstrued' as expressions of sexuality. The first volume of letters referred to in this article was published in 1920.