At least two of those of which I can recall were women. But the idiom is "to a man". It might be sexist of me to change a gender neutral idiom to be masculine

At least two of those of which I can recall were women. But the idiom is "to a man". It might be sexist of me to change a gender neutral idiom to be masculine, but using an innocuous masculine idiom is not harming anyone or promoting stereotypes. It's just using an idiom, man. or woman. or child. or political correctness bot.