You made your comment based on what you believe is acceptable. So did he. Everyone thinks what they are doing is right, and "what is the difference?", although

You made your comment based on what you believe is acceptable. So did he. Everyone thinks what they are doing is right, and "what is the difference?", although it may not look offensive, could have been the most hurtful 3-4 words he heard this week. His reply was probably as inappropriate as you bringing back "The pussy" and hurt him again since you "think he still is a pussy".