4 ms·
Reminds me of the ideas behind google's multi-axis transformer: https://arxiv.org/abs/2204.01697 https://arxiv.org/abs/2204.01697 Both using a hierarchical tra
by logophobia 3y ago
Reminds me of the ideas behind google's multi-axis transformer: https://arxiv.org/abs/2204.01697 https://arxiv.org/abs/2204.01697
Both using a hierarchical transformer, adapting the transformer network architecture to vision tasks more efficiently.