Yes, for example https://arxiv.org/pdf/2506.05410 https://arxiv.org/pdf/2506.05410 merges two neighboring tokens with the lowest sum of past attention scores, a

Yes, for example https://arxiv.org/pdf/2506.05410 https://arxiv.org/pdf/2506.05410 merges two neighboring tokens with the lowest sum of past attention scores, and this method would enable using future expected attention instead.