4 ms·

Attention Viz

• djoldman 3y ago
  About button: Attention Viz is an interactive tool that visualizes global attention patterns for transformer models. To create this tool, we visualize the joint embeddings of query and key vectors. paper: https://arxiv.org/abs/2305.03210 https://arxiv.org/abs/2305.03210 docs: https://catherinesyeh.github.io/attn-docs/ https://catherinesyeh.github.io/attn-docs/