4 ms·
I'll try to keep it productive though, since I imagine that businesses will continue to demand tools like this and it's foolish of me to think that someone won'
by conartist6 1y ago
I'll try to keep it productive though, since I imagine that businesses will continue to demand tools like this and it's foolish of me to think that someone won't make them.
You asked how you could make it better. You need to think of yourself as having two sets of customers. One set is the decision-makers, and the other is the people being decided on. If you were to be successful it would be by bridging that gap between those two groups. I can only imagine that it would involve pairing decision-making with systems of accountability, transparency, and justice, as we do in governments -- as is necessary to do in any civic system that wields power.
To expand:
- Accountability: Who ensures the rules are meant to be fair not discriminatory? What do you do when the real problem is that the rules need to change?
- Transparency: Can people understand why a decision was really made, or is how the system sees them a secret? If your goal is truly to help people then you need to enable them to help themselves by allowing them to understand the nature of their relationship to the decision-maker.
- Justice: When the system gets it wrong, there must be recourse. If someone is about to lose their livelihood over a paperwork error, there needs to be a system of judicial review that they can engage. The real world is messy, and if you want to create value in the real world you need to engage with the mess instead of trying to oppress it with a system of absolute rules.
- IanCal 1y agoLaws obviously vary by location but in the EU there is this: https://commission.europa.eu/law/law-topic/data-protection/rules-business-and-organisations/dealing-citizens/are-there-restrictions-use-automated-decision-making_en https://commission.europa.eu/law/law-topic/data-protection/r... Beyond that, it looks like this system gives you full audit logs and lets you backtest things which means you should be able to analyse the impact of a change and have a record of what decisions were made and how they were made.
- davidreisbr 1y agoThanks for the feedback! Making decisions transparent is a big focus area for us. Not only for fairness, but also because companies can't improve what they don't understand.
- davidreisbr 1y agoThanks for the feedback! Making decisions transparent is a big focus area for us. Not only for fairness, but also because companies can't improve what they don't understand. Nevertheless, we are a platform. We make it easy for deciders to do the right thing, but they are ones making final decisions.