4 ms·
The point is that assigning a FICO score -- any score -- is a strong predictor of future scores, to the person and those dependent on them. If the current score
by pron 11y ago
The point is that assigning a FICO score -- any score -- is a strong predictor of future scores, to the person and those dependent on them. If the current score is unfairly distributed in society due to other historical effects, the computation will actively work to maintain the distribution.
A quant doesn't care how they make their money, and they certainly have no desire in leaving their Nash equilibrium.
Again, if you say you want to enact a conservative policy, say so. It's perfectly OK. But don't program conservatism into an algorithm and then claim "it's only math". It isn't.
Of course, being in a Nash equilibrium makes conservative algorithms much easier, as they don't require bargaining with other players, but that doesn't make them any less conservative.
- AnthonyMouse 11y agoSuppose we have some algorithms which are trying to predict which team will win a game. People are going to bet money based on what the algorithms say, and teams benefit when more money is bet on them. The red team plays dirty. First they spread false rumours about the blue team. Most of the algorithms respond by reducing the blue team's chances of winning against the red team, but algorithm #5 successfully predicts that the rumours were false and people who bet using algorithm #5 made a lot of money. Now lots of people use variants of algorithm #5 and thereafter the red team has no luck getting anyone to believe their false rumours. In other words, if the algorithms are incorrect then we're all better off to fix them. Next the red team successfully lobbies the government to raise the blue team's taxes (even though the red team makes more money). Now the blue team has less money for training and equipment, which has actually reduced their chances of winning the game. Most of the algorithms successfully predict this, and then the blue team loses the next game. Your argument seems to be that the red team should be punished for this by having your algorithm stop preferring them. But now you're screwing over everyone else relying on your algorithm, who weren't responsible for the behaviour you're trying to punish. And thereafter no one trusts you to provide true information. If the red team is playing dirty and the math accurately predicts the result, the problem is not the math.
- drdeca 11y agodo you mean red team / blue team as in attack / defense or as in red tribe / blue tribe? or just names for teams?
- pron 11y agoYour analogy is incorrect because when it comes to social systems, how people bet actually changes the outcome, at least in the long run. So the dynamics are more like that the team that wins is the one that has the most people bet it would win. In general, the problem is not the math but our interpretation of the result. All the result says is that if we change nothing, this is the likely outcome. By interpreting the results to mean merely "this is the likely outcome", we are depriving people of the opportunity of getting out of local optima. Deciding to coordinate or deciding to have society maintain its Nash equilibria are both political choices -- not mathematical outcomes.
- AnthonyMouse 11y ago> Your analogy is incorrect because when it comes to social systems, how people bet actually changes the outcome, at least in the long run. That stipulation doesn't make the analogy incorrect. It's analogously an argument that we should bet on the team likely to lose tomorrow because more people betting on them will make them more likely to win next year. That is not a successful betting strategy even if it's true. It's just charity. And there is nothing wrong with charity, but then why use such a convoluted mechanism? If charity is what you want then just give your money to the blue team. > In general, the problem is not the math but our interpretation of the result. All the result says is that if we change nothing, this is the likely outcome. Which is what we need to know unless we're specifically trying to change something. And if we can find some particular unjustified bias in the algorithm then we are, and then we know what to do because we can adjust the algorithm. But if we can't find any such thing to adjust, if the algorithm is unbiased and accurate so far as we can tell, then what is it we're supposed to be trying to change? Just looking at e.g. the racial composition of the output doesn't actually tell you if anything is wrong. It could be (and often will be) that the algorithm is measuring other things that are correlated with race.