3 ms·
Self-attention and positional embeddings are ancient at this point (i.e., more than 5 years old). Here are a couple examples of methods: https://arxiv.org/abs/2
by thatguysaguy 3y ago
Self-attention and positional embeddings are ancient at this point (i.e., more than 5 years old). Here are a couple examples of methods: https://arxiv.org/abs/2112.06749 https://arxiv.org/abs/2112.06749
https://arxiv.org/abs/2205.12558 https://arxiv.org/abs/2205.12558