Attention is probably most easily conceptualized as run time reweighting. A powerful tool but it doesn't really change the underlying model it is just modifyin

Attention is probably most easily conceptualized as run time reweighting. A powerful tool but it doesn't really change the underlying model it is just modifying the weights at runtime.