3 ms·
One thing I haven't seen explicitly mentioned is the (probably) intrinsic limitations of AI/ML in classifying/predicting human behavior. For a number of years I
by leto_ii 6y ago
One thing I haven't seen explicitly mentioned is the (probably) intrinsic limitations of AI/ML in classifying/predicting human behavior. For a number of years I have worked on fraud prevention tasks where the goal was to take in some information about a payment and decide whether it was fraudulent or not.
Even though what we were doing was primitive and could have benefited from a lot more ML, I suspect that even then the best that you could have gotten would have been some sort of anomaly detection system that can catch a good share of the kind of fraud that you have seen in the past, but will never be very good at detecting an intrinsic change in fraudster behavior.
On top of this, especially when dealing with humans, you often are expected to be able to explain why a certain decision was made. Setting payments aside, think of predictive policing or sentencing decisions. In those cases ML is essentially guaranteed to build in all sorts of biases regarding somebody's race, gender, place of living etc.