2 ms·
"Unknown unknowns, on the other hand, are examples where a model is confident about its answer, but is actually wrong." So, these models are actually very much
by teekert 6y ago
"Unknown unknowns, on the other hand, are examples where a model is confident about its answer, but is actually wrong."
So, these models are actually very much like humans :)
"It Ain’t What You Don’t Know That Gets You Into Trouble. It’s What You Know for Sure That Just Ain’t So" -unsure [0]
At least humans know how to fix this (from Pocahontas):
"But if you walk the footsteps of a stranger
You'll learn things you never knew you never knew"
[0] https://quoteinvestigator.com/2018/11/18/know-trouble/ https://quoteinvestigator.com/2018/11/18/know-trouble/
- nerdponx 6y agoThe problem is not that data scientists don't know this. The problem is always one of finding the right "stranger" whose footsteps can be walked in. Or in the case of really huge models, it's a case of cost-benefit calculation so that you don't walk in more footsteps than you can afford.