3 ms·
As a laymen, I don't understand how "attention" and "explanation" are used here. Would you be able to summarize the terms and the contention?
by monroewalker 6y ago
As a laymen, I don't understand how "attention" and "explanation" are used here. Would you be able to summarize the terms and the contention?
- tmabraham 6y agorecently, a lot of neural network models, especially those in NLP (like GPT-3, BERT, etc.) use "attention" which basically is a way for neural networks to focus on certain subset of the input (the neural network can focus its "attention" to a particular part of the input). Explanations just refers to ways for explaining the predictions of the neural networks.
- zamfi 6y agoThese are deep neural net papers, specifically in NLP. Explanation: why the model (the deep neural net, that is) is doing what it's doing. Attention: a particular technique used in certain deep net models, invented a few years ago, that originally showed remarkable performance improvements in NLP (natural language processing) tasks, but has recently been applied in vision and elsewhere.