Lower number goes up, or higher number goes down, either can equally be described as "gap narrows". Is it wrong to say the "gender wage gap narrowed" when men'

Lower number goes up, or higher number goes down, either can equally be described as "gap narrows". Is it wrong to say the "gender wage gap narrowed" when men's inflation adjusted wages have fallen?