3 ms·
One thing I don't agree with is that notion of robustness is human specified, when they clearly measure robustness of a given feature before classification is c
by AstralStorm 8y ago
One thing I don't agree with is that notion of robustness is human specified, when they clearly measure robustness of a given feature before classification is changed.
Robustness is a systems statistical notion of amount or degrees of freedom of state perturbation required to change output, also taking into consideration the magnitude of change.
It is related to but not same as system theoretical stability. There's nothing human about the definition.
Robust features need not be human derived.
The desired degree of robustness vs absolute accuracy or precision or bias trade-off is human specified but generally the trade-off is not huge between these variables.
- omnicognate 8y agoTheir definition of robustness relies on a pre-specified choice of which set of perturbations to be "robust" to. They use the letter delta for this set in the paper, IIRC. This is where the "human" bit comes in: to define robustness in the abstract you would have to establish which perturbations "should" change the categorisation and which ones "shouldn't", which they avoid attempting to do.