The attention is sparse in a single attention head in a single layer, but the model still has a way to route information where it needs it given multiple attent

The attention is sparse in a single attention head in a single layer, but the model still has a way to route information where it needs it given multiple attention heads and multiple layers. Similarly, your computer is not physically connected to mine but I'm still able to read your comment.