I think it's very possible that we won't have good explanations for things that are this complicated and that change this quickly. I.e. massive matrices of numb

I think it's very possible that we won't have good explanations for things that are this complicated and that change this quickly. I.e. massive matrices of numbers that are trained and retrained regularly. Humans have a small amount of working memory, and anything bigger has to be knitted together from pointers to concepts stored in long term memory. Long term memory takes a while to construct. Let's say you take one single forward pass of a neutral network to output a single image. To really understand what's happening, you'd have to study that network for years, tracing which parts of the network's matrices influence which parts of the output image. How long would it take to really build a deep intuition about that single network, or even that single forward pass? I'd think as a starting point it would take as long to learn as a language, and probably much longer.