"The logical mechanism of the functional form of the model has very little to do with explainability" I'm not sure we are talking about the same thing, or whic

"The logical mechanism of the functional form of the model has very little to do with explainability" I'm not sure we are talking about the same thing, or which of the three sources in my comment you are reacting to. My understanding of "explainability" in this context is that it means "humans can understand why the model gives a certain prediction". It seems like you are using it to mean "humans can understand why the thing modeled does something (presumably by referring to the model)". That isn't what I thought people meant by the term, nor does it seem like a reasonable goal to me. Do we agree these are distinct ideas? Feel free to elaborate on where I've gone wrong.