4 ms·
> the resulting models all generalize quite poorly In this field, this kind of technology will be augmentative for the near-term at least, so generalization m
by ihnorton 8y ago
> the resulting models all generalize quite poorly
In this field, this kind of technology will be augmentative for the near-term at least, so generalization matters less than elsewhere provided the false negative rate is kept low enough. Outliers can be flagged for direct inspection.
- ska 8y agoIt's a mistake to think that generalization doesn't matter much. In this case your false positive rate can go through the roof also, to the degree the system becomes useless. More generally it means you don't understand well how your system will work on real world data, so can end up with lots of unfortunate surprises. It's true that if you are assuming a human/algorithm team some things are easier, but that doesn't make the problem go away.