3 ms·If the attention is masked, then yes they do.by anon291 1y agoIf the attention is masked, then yes they do.