3 ms·
Suppose we have some algorithms which are trying to predict which team will win a game. People are going to bet money based on what the algorithms say, and team
by AnthonyMouse 11y ago
Suppose we have some algorithms which are trying to predict which team will win a game. People are going to bet money based on what the algorithms say, and teams benefit when more money is bet on them.
The red team plays dirty.
First they spread false rumours about the blue team. Most of the algorithms respond by reducing the blue team's chances of winning against the red team, but algorithm #5 successfully predicts that the rumours were false and people who bet using algorithm #5 made a lot of money. Now lots of people use variants of algorithm #5 and thereafter the red team has no luck getting anyone to believe their false rumours.
In other words, if the algorithms are incorrect then we're all better off to fix them.
Next the red team successfully lobbies the government to raise the blue team's taxes (even though the red team makes more money). Now the blue team has less money for training and equipment, which has actually reduced their chances of winning the game. Most of the algorithms successfully predict this, and then the blue team loses the next game.
Your argument seems to be that the red team should be punished for this by having your algorithm stop preferring them. But now you're screwing over everyone else relying on your algorithm, who weren't responsible for the behaviour you're trying to punish. And thereafter no one trusts you to provide true information.
If the red team is playing dirty and the math accurately predicts the result, the problem is not the math.
- drdeca 11y agodo you mean red team / blue team as in attack / defense or as in red tribe / blue tribe? or just names for teams?
- pron 11y agoYour analogy is incorrect because when it comes to social systems, how people bet actually changes the outcome, at least in the long run. So the dynamics are more like that the team that wins is the one that has the most people bet it would win. In general, the problem is not the math but our interpretation of the result. All the result says is that if we change nothing, this is the likely outcome. By interpreting the results to mean merely "this is the likely outcome", we are depriving people of the opportunity of getting out of local optima. Deciding to coordinate or deciding to have society maintain its Nash equilibria are both political choices -- not mathematical outcomes.
- AnthonyMouse 11y ago> Your analogy is incorrect because when it comes to social systems, how people bet actually changes the outcome, at least in the long run. That stipulation doesn't make the analogy incorrect. It's analogously an argument that we should bet on the team likely to lose tomorrow because more people betting on them will make them more likely to win next year. That is not a successful betting strategy even if it's true. It's just charity. And there is nothing wrong with charity, but then why use such a convoluted mechanism? If charity is what you want then just give your money to the blue team. > In general, the problem is not the math but our interpretation of the result. All the result says is that if we change nothing, this is the likely outcome. Which is what we need to know unless we're specifically trying to change something. And if we can find some particular unjustified bias in the algorithm then we are, and then we know what to do because we can adjust the algorithm. But if we can't find any such thing to adjust, if the algorithm is unbiased and accurate so far as we can tell, then what is it we're supposed to be trying to change? Just looking at e.g. the racial composition of the output doesn't actually tell you if anything is wrong. It could be (and often will be) that the algorithm is measuring other things that are correlated with race.
- pron 11y ago> That is not a successful betting strategy even if it's true. If we can determine the outcome, why is it not a successful betting strategy? > It's just charity. For something to be charity, you need to determine that the receiver does not rightfully deserve it, and the giver does. That distinction relies on values, and every person may come up with a different labeling of something as charity or not. I studied history and my views are largely shaped by that. I believe that the current distribution of power and resources in society is largely a result of what you may call "charity" to the people who are now rich (and that's putting it very kindly). > Which is what we need to know unless we're specifically trying to change something. As what we do or don't do determine the outcome, any decision is a political choice. Saying that we're specifically trying to change something is no different from saying that we're specifically trying to keep something the same. Today's bet is tomorrows outcome, and you must place a bet. > Just looking at e.g. the racial composition of the output doesn't actually tell you if anything is wrong. We liberals have an assumption. It is no more arbitrary than conservative assumptions. The assumption is that -- unless proven otherwise -- no group of people wishes to yield power over themselves to others, and that different groups have similar capacity for "power-gaining" achievement. Therefore, if we look at the racial or sexual makeup of a certain source of social power and we find a gross disparity, we want to balance it. > It could be (and often will be) that the algorithm is measuring other things that are correlated with race. Absolutely. The problem is not what the algorithm tells you, but what you do with the information. Because what determines the future outcome is not the output of the algorithm, but your decision on how to act.