Untrue! Three are a number of valid strategies for using attention in non sequential models. Attention is really just generating a mask to apply on a feature re

Untrue! Three are a number of valid strategies for using attention in non sequential models. Attention is really just generating a mask to apply on a feature representation; it generalized perfectly well to classical models.