That's possibly a fair description of the kind of as-late-as-possible de-biasing that I find insufficient. I think there is not nearly enough research into de-

That's possibly a fair description of the kind of as-late-as-possible de-biasing that I find insufficient. I think there is not nearly enough research into de-biasing at training time, perhaps because it would be discouraged by the reward structure of our field. ("You mean I can make my model more complex and my paper longer, and in return I lose the 0.15% accuracy gain that's the entire reason I could call the result 'state of the art'? Sure, I'll get right on that!")