There’s no helping the incurious, but there are indeed reams of explorations unto weights and their explanations. One of my personal favourites is Zeiler and F

There’s no helping the incurious, but there are indeed reams of explorations unto weights and their explanations. One of my personal favourites is Zeiler and Fergus https://arxiv.org/abs/1311.2901 https://arxiv.org/abs/1311.2901 Tom Zahavy’s “Greying the black box” on deep RL comes to mind too https://arxiv.org/abs/1602.02658 https://arxiv.org/abs/1602.02658 OpenAI has their Microscope tool for investigating individual neurons https://openai.com/research/microscope https://openai.com/research/microscope; more recently OpenAI shared research and tooling leveraging a powerful language model to explain a smaller model’s neurons. https://openai.com/research/language-models-can-explain-neurons-in-language-models https://openai.com/research/language-models-can-explain-neur... For a true toy box exploration playground.tensorflow.org is worth a play These may or may not satisfy your curiosities — your perfect tool may not exist…yet. I would argue that the sampling of extant work above are indicative that it and more are possible.