As slick as this kind of thing looks, I don't think it does help much to see raw filters on an image-by-image basis. The kind of insights that I think are more

As slick as this kind of thing looks, I don't think it does help much to see raw filters on an image-by-image basis. The kind of insights that I think are more important are the abstract ones, like the recent paper about universal adversarial perturbations and the geometry of the decision boundary. Visualizations can help, but more in the sense of rapidly iterating through bespoke visualizations to generate and test hypotheses. And to do that efficiently you don't need a slick tool that does one kind of visualization, you need a slick 'grammar' to efficiently build new visualizations with, Bret Victor style.