3 ms·
These visualizations are very cool, and will hopefully lead to more understanding of what's happening with neural networks internally. The next thing we need is
by joewferrara 3y ago
These visualizations are very cool, and will hopefully lead to more understanding of what's happening with neural networks internally. The next thing we need is an example/write up of someone using these visualizations to either 1. troubleshoot and improve a neural network or 2. interpret the meaning of the weights of neural network. What would be amazing is using these visualizations as a framework for building a new neural network interpretability tool that identifies common patterns of weights in neural networks that are discovered to work well. This could lead to more insight into when a neural network has converged "correctly".
- janalsncm 3y agoVisualization of weight matrices can be especially helpful for architectures like DCN or FM/FFM. You can directly see feature importances which is computationally infeasible in a fully connected network for example.