2 ms·

I think one of the most important things we can do is to establish liability for prediction models to the people using the model. At the end of the day if you

I think one of the most important things we can do is to establish liability for prediction models to the people using the model. At the end of the day if you falsely arrest someone, fire them on bad grounds, etc then you're the responsible party. The excuse "Well but someone told me to!" doesn't work any better when you're blaming a machine instead of a person - it's still bunk. If the model is broken, well then that's on you. A vendor sold you a magical model saying it was perfect and you got in trouble anyways? Well, you can go on and try to sue the vendor and hash that out - after you pay for your mistake. It's critically important we don't allow models to become get out of jail free cards.

progval 6y ago
Other people who should be liable, at least as much as those using the model: 1. sellers/providers of the model, if they lied about the efficiency 2. buyers/deciders, who not necessarily the same as those using the model (usually their bosses)
- vorpalhex 6y ago
  You can still go after a seller for making false claims, but you are liable for your actions - full stop. Unless the seller forced you to fire someone or arrest someone based on the model, you executed the action. Someone who writes your legal contract isn't liable if you badly enforce it.