5 ms·

I like the proposal from the EU that automated decisions with a material impact must firstly come with a justification -- so the system must be able to tell you

I like the proposal from the EU that automated decisions with a material impact must firstly come with a justification -- so the system must be able to tell you why it came out with the answer it gave -- and must have the right of appeal to a human. The implementation is the difficult bit, of course, but as a principle, I appreciate the ability to sanity-check outputs that currently lack transparency.

dasboth 10y ago
Interpretability is going to be a huge area of research in machine learning, what with the advent of deep learning techniques. It's hard enough explaining the output of a random forest, what about a deep net with 100 layers? In some cases it doesn't matter, e.g. you generally don't care why Amazon thinks you should buy book A over book B, but in instances where someone's prison sentence is the output, it will be vital.