Surely that could be solved by crypto? I.e. you don't actually get a list of names, but list of asymmetric keys, and when your friend joins their key can match

Surely that could be solved by crypto? I.e. you don't actually get a list of names, but list of asymmetric keys, and when your friend joins their key can match the one in my list?