I think there is hope, there is a very nice paper where they automaticaly produce both heatmaps and textual explanations of the label given by the neural networ

I think there is hope, there is a very nice paper where they automaticaly produce both heatmaps and textual explanations of the label given by the neural network (used to detect and classify fractures). It is detailled here : https://lukeoakdenrayner.wordpress.com/2018/06/05/explain-yourself-machine-producing-simple-text-descriptions-for-ai-interpretability/ https://lukeoakdenrayner.wordpress.com/2018/06/05/explain-yo...