IIRC the last XAI approch I read about basically gives you a local linear approximation or Jacobian of the decision surface. You take a look at the biggest term

IIRC the last XAI approch I read about basically gives you a local linear approximation or Jacobian of the decision surface. You take a look at the biggest terms and call them an explanation. Not too shabby, probably. I don't know if all of the XAI project follows that approach. Edit: Framing