3 ms·
Assume that you are insurance company with access to customers social media profiles. You find out that if customer has a friend who posts pictures of fast mot
by nabla9 9y ago
Assume that you are insurance company with access to customers social media profiles.
You find out that if customer has a friend who posts pictures of fast motorcycles that increases the probability of customer making $100,000 claim in the future to 2% from previous 1%. Is it fair to double their insurance payment to make up for the increase in expected value even if the number of false positives is huge? General efficiency increases and customers can save money if they select their friends better. This might be how Chinese social scoring system might work in the future. Society as a whole optimizes itself.
What if instead of the insurance claim, the risk is homicide or rape. Should algorithmic judge take that into account when weighing the evidence?
Personally I think unconstrained algorithm in criminal cases is ethically wrong. Justice should be individualized or it's not justice.
In some other cases it might be justifiable.
- taneq 9y agoDon't they do precisely that, across a whole bunch of data? Not "friends on facebook" but location, habits, age, etc.
- nabla9 9y agoYes. That's the idea when managing insurance risk. The question is if there are variables that should be excluded because optimizing trough them has harmful effects to the society and it's unfair. Smoking or alcohol use are noncontroversial variables. The quality of your friends, your political leanings are controversial.
- Houshalter 9y agoThis is a different problem than what people are complaining about. In fact it may be the exact opposite problem in some ways. The problem you state is that, if you base an outcome on some measure, people will manipulate that measure. E.g. a companies use college education as a proxy for competence. And now everyone has to get a college education to get a good job. Society may be better if use of these measures is banned, even if they are predictive. But this is not what's happening here. I don't see anyone claiming they changed their job, marital status, age, neighborhood, or any of the other measured factors. Just to manipulate this algorithm. These measures are probably safe to use in these circumstances, as far as this specific problem is concerned. >Justice should be individualized or it's not justice. There's no such thing as "justice". If you don't use an objective statistical algorithm to decide these things, you must use humans. And humans are far more biased and less fair. See my other comment.