3 ms·
I believe models with attention are more appropriate for ‘telling’ what they re focusing on , at least if the question is which part of the image they re focusi
by buboard 8y ago
I believe models with attention are more appropriate for ‘telling’ what they re focusing on , at least if the question is which part of the image they re focusing on
- minimaxir 8y agoAttention is only (edit: typically) for sequential models (e.g. time series), not image-based convolution models.
- sdenton4 8y agoUntrue! Three are a number of valid strategies for using attention in non sequential models. Attention is really just generating a mask to apply on a feature representation; it generalized perfectly well to classical models.