4 ms·
In the context of attention, there is a very interesting recent paper that warns against conflating attention and token importance - "Is Attention Interpretable
by abhgh 7y ago
In the context of attention, there is a very interesting recent paper that warns against conflating attention and token importance - "Is Attention Interpretable?" [1]. This is an accepted paper in ACL-2019:
[1] https://www.aclweb.org/anthology/P19-1282 https://www.aclweb.org/anthology/P19-1282
- stochastic_monk 7y agoSee also Attention is Not Explanation [0]. [0] https://www.aclweb.org/anthology/N19-1357 https://www.aclweb.org/anthology/N19-1357
- abhgh 7y agoThanks!
- physicsyogi 7y agoThere's a rebuttal to this as well: Attention is not not Explanation. https://arxiv.org/abs/1908.04626 https://arxiv.org/abs/1908.04626