4 ms·
That's because what's called 'debiasing' is not actually removing bias but adding another opposite one at the superficial layers we can actually notice.
by fvdessen 9y ago
That's because what's called 'debiasing' is not actually removing bias but adding another opposite one at the superficial layers we can actually notice.
- rspeer 9y agoThat's possibly a fair description of the kind of as-late-as-possible de-biasing that I find insufficient. I think there is not nearly enough research into de-biasing at training time, perhaps because it would be discouraged by the reward structure of our field. ("You mean I can make my model more complex and my paper longer, and in return I lose the 0.15% accuracy gain that's the entire reason I could call the result 'state of the art'? Sure, I'll get right on that!")