3 ms·
About button: Attention Viz is an interactive tool that visualizes global attention patterns for transformer models. To create this tool, we visualize the join
by djoldman 3y ago
About button:
Attention Viz is an interactive tool that visualizes global attention patterns for transformer models. To create this tool, we visualize the joint embeddings of query and key vectors.
paper: https://arxiv.org/abs/2305.03210 https://arxiv.org/abs/2305.03210
docs: https://catherinesyeh.github.io/attn-docs/ https://catherinesyeh.github.io/attn-docs/