4 ms·
The point is that you trust those people. You can't trust a black-box model, but you can trust a result if the explanation that is provided actually explains it
by inimino 3y ago
The point is that you trust those people. You can't trust a black-box model, but you can trust a result if the explanation that is provided actually explains it. That is, if the explanation has factors X, Y, and Z, then every time those hold the result should be the same.
Otherwise, you are just trusting the training set and the training process. Sometimes that's fine, as the article also mentions.
- barking_biscuit 3y agoNo, the point is those people are also a black-box to you and they are a black-box that you trust because of YOUR training set and training process.
- inimino 3y agoYes, your exact thought process may be a black box to me, but I myself am a black box made to the same (DNA etc) spec. We have millions of ancestral years of experience trusting each other and we know how to simulate each other because we are the same kind of black box. Your trust in other humans is explained much more by your priors over human behavior than by any observed behavior of individual humans--that's layered on top. In short: we trust people because we can model them effectively, and being one helps. We trust mathematical models and traditional programs because we understand them and can check their work in any specific instance. Large ANNs don't (yet) benefit from either of these two kinds of trust.