It's pretty much impossible to determine from the outside whether the algorithm discriminates against woman (without a reasonably large and actually random samp

It's pretty much impossible to determine from the outside whether the algorithm discriminates against woman (without a reasonably large and actually random sample of customers). But that is also part of the complaint, as the algorithm is a black box that even the customer support employees can't look into. Humans just blindly following a black box algorithm without the option to manually handle cases where the algorithm produces weird results has quite a dystopian feel to me. Especially if it's used for more consequential cases than credit card limits.