5 ms·
> auditable proof that these models are safe, fair Impossible to deliver
by richwater 1y ago
> auditable proof that these models are safe, fair
Impossible to deliver
- sgt 1y agoAcceptance criteria has entered the chat.
- potatoman22 1y agoEvidence for safe and fair AI systems is possible as long as you define what "safe" and "fair" mean for your usecase. Fairness might look like "no cohort has >5% higher false positive rate than another" and safety might mean "the model must have a false negative rate of less than 15%". Safety more so encompasses the workflows around the model, including human intervention, auditing, monitoring, etc. Here's a good overview of fairness: https://learn.microsoft.com/en-us/azure/machine-learning/concept-fairness-ml https://learn.microsoft.com/en-us/azure/machine-learning/con... and there's plenty of papers discussing how to safely use predictive analytics and AI in healthcare. I don't know if this product can give proof for safe and fair ML systems, but it's not impossible to use these things safely and fairly.
- ariavikram 1y agoThanks for your question. Parachute's workflows are built around widely accepted conventions for safety and fairness for AI models in healthcare such as NIST AI RMF, CHAI and HAIP's HEAAL framework.
- padolsey 1y agoYou're right; we should not even try. Better to have 0% compliance coverage and your honor than 90% coverage as best-effort.