It'd be ok if that's the expectation. The social contract is such that both parties have agreed (by using the same client/network that offers those features), s

It'd be ok if that's the expectation. The social contract is such that both parties have agreed (by using the same client/network that offers those features), so changing it on only one side feels invasive because you had the expectation of privacy that you didn't actually have.