If you weren't appealing to authority you could make your point without referring to an authority. But what you told me was that there is an authority who said

If you weren't appealing to authority you could make your point without referring to an authority. But what you told me was that there is an authority who said something that I am not allowed to dispute without also becoming part of said authority. Hence my reaction: your appeal to authority isn't convincing. Feel free to use exactly the same arguments your authority would use, but just saying "because they said so" won't convince me.