Sure, backprop is fairly simple, but the thing it produces is somewhat complex, and we seem to find it hard to explain “why” the weights it finds work (even tho

Sure, backprop is fairly simple, but the thing it produces is somewhat complex, and we seem to find it hard to explain “why” the weights it finds work (even though we understand clearly how it finds weights that do work), right? That seems sufficiently “black-box-ish” to me?