My theory is that upper class women had much more complicated clothing, with multiple layers. Some dresses had buttons on the back for example, A man's shirt

My theory is that upper class women had much more complicated clothing, with multiple layers. Some dresses had buttons on the back for example, A man's shirt and jacket was simpler. A man was expected to be more physically active and probably needed to take on/off his jacket several times a day without help.