3 ms·
But what is the situation in real life? Can I get some feature importance scores say from tensorflow model?
by reality_hacker 9y ago
But what is the situation in real life?
Can I get some feature importance scores say from tensorflow model?
- therajiv 9y agoI'll agree with you that it's much harder than it should be (thankfully, finding the implementations is the hard part, not using them), but yes, these methods do exist. DeepLIFT (the method I linked in my original comment: https://github.com/kundajelab/deeplift https://github.com/kundajelab/deeplift), takes a Keras model (with Theano or TensorFlow backend) as input and provides feature importance scores for any desired layer of the network (raw data inputs, inputs to dense layers following convolution, etc.). Keras-Vis (https://github.com/raghakot/keras-vis https://github.com/raghakot/keras-vis) is another nice package that allows for easy visualization of saliency maps and convolutional filters. Perturbing inputs and looking at the effect on the output of the network is another technique people use pretty often. I think there's a lot of room for this space to become easier to use, especially for newer deep learning practitioners. To that point, I definitely agree with the author of this blog post.
- alexcnwy 9y agoThanks for the links - a friend of mine is working on something like DeepLIFT but I hadn't heard of it...