3 ms·
> What's an acceptable error rate for such a model? Ideally, 0%. We're talking about people's lives and health here. But, right, realistically: > What's the
by kelnos 3y ago
> What's an acceptable error rate for such a model?
Ideally, 0%. We're talking about people's lives and health here.
But, right, realistically:
> What's the human baseline?
Good question, but I would hope it's much better than a 90% error rate. And if it's not, any sane company in any sane industry would figure out why things are that bad, and fix it. Of course, insurance companies are the scum of the earth, and have a huge incentive to get things wrong in this way.
- kelseyfrog 3y agoWhy is there a different standard between the model and a human? From the perspective of the business, whether a model or human causes the error is immaterial. > Any sane company in any sane industry would figure out why things are that bad, and fix it. The function of a thing is its consequences. So we have to conclude that the reason the model had a 90% error rate was to have a 90% error rate. It's aligned with business incentives to be so.